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ABSTRACT 

In this document I develop a weight function theory of positive order basis function interpolants and 

smoothers. 

In Chapter 1 the basis functions and data spaces are defined directly using weight functions. The data spaces 
are used to formulate the variational problems which define the interpolants and smoothers discussed in 
later chapters. The theory is illustrated using some standard examples of radial basis functions and a class 

of weight functions I will call the tensor product extended B-splinos. 

Chapter 2 shows how to prove functions are basis functions without using the awkward space of test 
functions So,n which are infinitely smooth functions of rapid decrease with several zero-valued derivatives 
at the origin. Worked examples include several classes of well-known radial basis functions. 
The goal of Chapter 3 is to derive 'modified' inverse-Fourier transform formulas for the basis functions and 
the data functions and to use these formulas to obtain bounds for the rates of increase of these functions 
and their derivatives near infinity. 

In Chapter 4 we prove the existence and uniqueness of a solution to the minimal seminorm interpolation 
problem. We then derive orders for the pointwise convergence of the interpolant to its data function as the 
density of the data increases. 

In Chapter 5 a well-known non-parametric variational smoothing problem will be studied with special 
interest in the order of pointwise convergence of the smoother to its data function. This smoothing problem 
is the minimal norm interpolation problem stabilized by a smoothing coefficient. 

In Chapter 6 a non-parametric, scalable, variational smoothing problem will be studied, again with special 
interest in its order of pointwise convergence to its data function. 
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2 Contents 

0.1 Introduction 

In this document I develop a weight function theory of positive order basis function interpolants and 
smoothers. Note that the Appendix of this document contains a hst of basic notation, definitions and 
properties also used in this document. 

This document had its genesis in the development of a scalable algorithm for Data Mining applications. 
Data Mining is the extraction of complex information from large databases, often having tens of millions 
of records. Scalability means that the time of execution is linearly dependent on the number of records 
processed and this is necessary for the algorithms to have practical execution times. One approach is to 
develop additive regression models and these require the approximation of large numbers of data points 
by surfaces. Here one is concerned with approximating data by surfaces of the form y = f{x), where 
and d is any dimension. Smoothing algorithms are one way of approximating surfaces and 
in particular we have decided to use a class of non-parametric smoothers called basis function smoothers, 
which solve a variational smoothing problem over a semi-Hilbert space of continuous data functions and 
express the solution in terms of a single basis function. Indeed, several years ago I succeeded in developing 
a scalable smoothing algorithm(unpublished) of the basis function type. This algorithm was derived by 
approximating a minimal smoothing problem on a regular rectangular grid. In this document we develop 
some theoretical tools to construct and analyze it. This theoretical approach applies in any dimension 
but the smoothing algorithm is only practical up to three dimensions. In higher dimensions the matrices 
are too large to put into computer memory. 

I started my Masters degree (supervised by Dr. Markus Hegland and Dr. Steve Roberts at the ANU, 
Canberra, Australia) searching for a scalable basis function smoothing algorithm and had the good 
fortune to devise such an algorithm by approximating, on a regular grid, the convolution in Definition 
38 of the space Jq in Dyn's review article For the case of zero order basis functions this algorithm 
is analyzed in Chapter 4 of the document Williams [12], and the positive order basis function case is 
studied in Chapter [6] of this document. 

Dr. Hegland was particularly interested in using the tensor product hat (triangular) function as a basis 
function. At about this time we had a visit by the late Professor Will Light who showed me his paper [TT] 
which defined basis functions in terms of weight functions using the Fourier transform. Light and Wayne's 
weight function properties, given in Definition [3] below, were designed for positive order basis functions 
which excluded the tensor product hat function. They were designed for the well-known 'classical' radial 
weight functions. I therefore developed a version of his theory designed to generate zero order basis 
functions, including both tensor product and radial types. This theory was developed in Chapter 1 of 
Williams [22] and requires that the basis functions have Fourier transforms which can take zero values 
outside the origin since this is a property of hat functions. 

Chapter by chapter: 

Chapter [T] The goal of this chapter is to extend the theoretical work of Light and Wayne in [TT] to 
allow classes of weight functions defined using integrals and which allow tensor product weight functions. 
Two weight function definitions are introduced, one designed for the standard radial weight functions 
and one designed for tensor product functions. These definitions allow for basis functions which have 
Fourier transforms which are zero on a closed set of measure zero and are analogous to the zero order 
definitions introduced in Williams [22]. These definitions involve the positive integer order parameter 9 
and the smoothness parameter n which can take any non-negative real value. 

A class of tensor product weight functions are introduced which I call the extended B-splines. 



of the weight function. We then prove some completeness and smoothness properties of the data space 
as well as some smoothness and positive definiteness properties of the basis function. In fact the data 
space consists of continuous functions and the basis functions are continuous, and the data space is used 
to define the variational interpolation and smoothing problems of later chapters and the basis functions 
are used to express their (unique) solutions. 

The extended B- spline basis functions are shown to be the convolutions of hat (triangle) functions. 

Chapter [2] shows how to prove functions are basis functions without using the awkward test functions 
*S'0,2e ^ {<t> ^ S : D°'(f) (0) = 0, \a\ < 29} where S is the C°° space of rapidly decreasing functions given 
in Definition 12431 Worked examples include several classes of well-known radial basis functions, the 
choice here following Dyn [1]: the thin-plate splines, the shifted thin-plate splines, the multiquadric and 
inverse multiquadric functions and the Gaussian. In the last section I will illustrate the method using a 
non-radial example: the fundamental solutions of homogeneous elliptic differential operators. 



Both the semi-inner product data space 
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The goal of Chapter [3] is to derive 'modified' inverse-Fourier transform formulas for basis functions 
and the data functions and to use these formulas to obtain bounds for the rates of increase near infinity 
of these functions and their derivatives. This will be done by proving a general inverse- Fourier transform 
formula for a subspace of the distributions and then applying it to both the basis functions and the data 
functions. Some other basis function properties are derived from their weight function properties. 

Chapter [4] studies the minimum seminorm interpolation problem. Topics include unisolvency and 
Lagrange polynomial interpolation and related operators and matrices, the existence and uniqueness 
of the basis function solution, a matrix equation for the solution and the pointwise convergence of the 
interpolant to its data function on a bounded region. 

We use a data function fd e and unisolvent independent data X — l^^^'^'' } contained in 
a bounded data region 17 to generate N data points {x^'^\ fd {x'^'^'^)) and the interpolation problem 
requires us to minimize \ -\^ g over all / S X^ which interpolate these data points. The seminorm |-|^^ ^ is 
converted into a Light norm |j-|j^ g and the problem is reformulated as the minimum norm interpolation 
problem. Geometric Hilbert space theory using orthogonal projections shows the solution, denoted Txfd, 
is unique. Indeed, this solution is identical to that of the seminorm problem and it lies in the finite 
dimensional basis function space Wg,x (Definition I130|) . It is called a basis function solution. 

We are now interested in what happens to the interpolant as the data X becomes denser in when 
we use the cavity measure of data density 

hx = sup dist (x, X) . 

xefi 

Theorem ll52l establishes an error estimate of order 77 — min {9, i [2kJ } for the interpolant in the sense 
that there are positive constants kj and h such that 

\fd{x)-ixfd{x)\<\fdL^gkj{hx)\ xen,fdexl (i) 

when hx < h. 

Note that in the case of the thin-plate, the shifted thin-plate and the Gaussian radial basis functions 
the Light and Wayne weight function definition of [TT] yields the same orders of convergence as ob- 
tained above. However, slightly improved orders of convergence are obtained later: see CoroUarv 11571 and 
examples where an improvement of 1/2 is obtained for the shifted thin-plate splines. 

Chapter [5] studies the well-known Exact smoother problem (our terminology) which stabilizes the 
interpolant by adding a smoothing coefficient to the seminorm functional. Topics include the existence 
and uniqueness of the basis function solution i.e. the Exact smoother, a matrix equation for the solution 
and the convergence of the solution to its data function. 

Using the same data as the interpolation problem the Exact smoother problem requires us to minimize 
the functional 

1 ^ 2 

Je [f] = P \f\l,0 + JjJ2\f (^^^0 ~ (^^'0 I ' 

for / e X^. The proof will be carried out within a Hilbert space framework by formulating (Definition 
I168P the smoothing functional in terms of an inner product (u, v)y — p (ui, ui)^, W {'S-2,V2)c« the 

product space V = Xf^ (g) and the continuous operator Cx ■ X^ — > V defined by Cxf = {f,^xf 



where £xf = (/ (a;^'''))). We can now write Je [/] = Cxf — (o,Sxf^ and using the technique of 
orthogonal projection it is shown in Theorem 11711 that a unique solution to the smoothing problem 
exists given by Se = (Cx^x) ^ ^x^xfd- Like the interpolant, the Exact smoother lies in the finite 
dimensional basis function space Wg,x and a matrix equation 15.201 is derived for the coefficients of the 
basis functions. 

To derive our estimates for the Exact smoother error \se {x) — fd {x)\ on a bounded data region we 
make use of the operators Cx and C*-^. Now is an equivalent norm to ||/||^ g which implies that 

Xf^ is also a reproducing kernel Hilbert space under the inner product {Cx f, Cxf jy- It then follows 
that there exists a unique Rv,x G V such that / (x) = {Cxf, Rv,x)y and Rx = C*xRv,x- Thus, using the 
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geometric properties of the orthogonal projection 

|Se(x)-/d(x)| = \{Cx {Se- Id).Rv..)v\ < \\Cx {^e - fd)\\v \\RvM\ 



< 



Cxfd-[0,£xfd 
Ifdlw.eVpWPvMlv 



^ \\Rv,x\\v 



We then estimate Hi^y.^jHy and show fea'n l5.4'5l) that there exist positive constants fee, fcg and h' such 
that 

|se (x) - fa < \fdL,e ke {K {hxf + ^/n^p) , x G fl, G 

when hx < h! . Here X has Nx points and fcefc^ — kj. The latter equation means that when p = 
the smoother estimate coincides with the interpolant error estimate. As with the interpolant estimates, 
slightly higher orders of convergence can be obtained - see CoroUarv 11571 and examples. 

Chapter [6] studies the scalable Approximate smoother (our suggested name). Topics include the 
derivation of the Approximate smoother problem and the existence, uniqueness of its solution i.e. the 
Approximate smoother, a matrix equation for the smoother, its scalability and the pointwise convergence 
of the smoother to the Exact smoother and to its data function. 

Using data generated by a data function fd S and a fixed set X' C M'' the Approximate smoother 
problem requires us to minimize the Exact smoother functional[2]over the finite dimensional space Wg,x' ■ 
Using Hilbert space techniques and then matrix techniques the smoother Sa will be shown to exist, be 

N' M 

unique and satisfy the regular matrix equation l6.10l i.e. if Sa {x) — ^ a[G {x — x'^) + ^ j3'^pi [x) then 



{2nY NpGx'.x'+Gx',xGx,x' Gx',xPx Px' 
PlGx,x' P^Px Om 

Px> Om Om 



a' \ 




I Gx',x 


13' 


\- 


Pi 


7' J 




\ Om,n 




where: Gx'.x' ^G{x\- x^), Gx'^x ^G{x\- Gx'.x = G - x;), Px 
{pj {x^)) and {pi} is a basis for the polynomials Pe of degree less than 9. 

The Approximate smoother matrix is N + N' square and this dependence on the number of data 
points N implies computational scalability i.e. the computational effort required to construct and solve 
the matrix equation depends linearly on the number of data points N. 

For a bounded data region fl we first derive some uniform, pointwise convergence results which do not 
involve orders of convergence e.g. in Corollary [229] it is shown that as the points in X' get closer to those 
in X the Approximate smoother converges uniformly to the Exact smoother on fl. 

Orders of pointwise convergence are derived for the convergence of the Approximate smoother to the 
Exact smoother e.g. estimate 16.391 savs that for some constants B,C,r > 

\s,{x)-Sa{x)\<\fdL^g(^l + B^!^^^^ i^BikxT'' +G^/^ xen,fdeXl (4) 

when hx>,hx < r. Here hx — sup dist (cj, X) and hx> = sup dist (tj, X') measure the density of the 

cj^fl G O 

point sets X and X' . 

These estimates are then added to the Exact smoother error formulas of Chapter O to obtain error 
estimates for the Approximate smoother e.g. estimate 16.491 

Notation 1 Regarding notation for distributions, in 0T| / Light and Wayne used an operator notation 
which I feel significantly reduced the readability of an already difficult paper, especially replacing (ix)'^ 
by Vy (x) and replacing the exponential e'^^ by (y) . For me this turned old mathematical friends into 
strangers. So I have settled on the notion of an action variable e.g. in the equations 

involving a distribution f and a test function (j), ^ will be called the action variable. I will also use the 
dot notation e.g. 



|V> = /,M> , [fi--^).^] = [f,^i- + x)] 



|2 



My aim is to retain as much as possible of the form of 'conventional' mathematical expressions. 



1 

Extensions of Light's class of weight functions 



1.1 Introduction 

The goal of this chapter is to extend the theoretical work of Light and Wayne in [TT] to allow classes 
of weight functions analogous to the zero order weight functions developed in Chapter 1 of Williams 
[22j i.e. weight functions which can generate positive order tensor product basis functions and the radial 
basis functions which have Fourier transforms with zeros outside the origin. A class of weight functions 
which I call the extended B-splines of positive order is used to illustrate the weight function properties 
and the basis function theory. Besides the basis function theory I have shown Light and Wayne's semi- 
Hilbert function spaces are still valid for the expanded weight function class but I give a different proof 
of completeness that uses single mappings in a manner analogous to Sobolev space theory. 
The material of this chapter can be summarized as: 

1. Define the positive order weight function properties and present equivalent properties and relation- 
ships between them. Introduce the extended B-spline weight functions which are tensor product 
functions with bounded support. 

2. Define the semi-inner product space of continuous data functions and prove its completeness and 
smoothness properties. 

3. Define the basis distributions of positive order and prove continuity and positive definiteness prop- 
erties. Derive convolution formulas for the extended B-spline basis functions. 

The theory of this document lays the foundations for the study of the basis function interpolation and 
smoothing problems introduced in later chapters. 

1.2 An extended class of positive order weight functions 

In this section we introduce our extended class of positive order weight functions. 
1.2.1 Zero order weight functions and basis functions 

In the Chapter 1 [32] Williams developed a theory of zero order weight functions and basis functions. 
Here we shall summarize the relevant parts of this theory which only needs simple Fourier theory e.g. 
Section 2.2 of Petersen ^16 . However, here we will allow non-integer values of the smoothness parameter 
K to match the positive order weight function definitions below. 

Definition 2 Zero order weight functions with smoothness parameter n 

A weight function's properties are defined with reference to a set A C which is closed and has 
measure zero. A weight function w is a mapping w ■.M.'^ ^ M. which has the properties: 
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1. Extensions of Light's class of weight functions 



Wl There exists a closed set A with measure zero such that w is continuous and positive outside A i.e. 
w e C(") {R'^\A) andw>0 on R'^XA. 

W2 For some (possibly non-integer) number k > 

-dx < oo, < s < K. (1.1) 



w (x) 

The basis function of order zero is defined by 

G=[-.] ■ (1-2) 



V 



w 



It follows directly from Corollary 2.12 of Petersen [inj that G G C^'^^''^'' and so I sometimes call k the 
weight function smoothness parameter. 



1.2.2 Motivation for the extended weight function class properties 

I will now state the Light and Wayne weight function properties extracted from Section 3 of Light and 
Wayne [Tl]. To this list I have added property B3.5 - not defined by Light and Wayne. The 

space X of functions mentioned in this definition were used to define the variational interpolant. The 
basis function is used to construct the interpolant. 

Definition 3 Light and Wayne 's weight function properties Ul^ 

A weight function w is a mapping w : R'' R which has properties A3.1 and A3. 2 below, as well as 
combinations of the other properties. Properties A3.1 and A3. 2 are used to define the semi-inner product 
space X of distributions. 

A3.1 w e CW(M''\0). 
A3.2 w{x) >Q on R''\0. 

Properties A3. 3 and A3. 4 are used to prove the completeness of the X space and to allow the 
definition of a basis distribution. 

A3.3 1/w e iL- 

A3. 4 There exist n, R > and Cr > such that 

< Cr\x\-'^, \x\ > R. 

W(X) 

B3.5 We say that w has property B3.5 for parameters fi and order 6 if w satisfies property A3. 4 for 
some fi satisfying ii + 6 > d/2. 

I have constructed Property B3. 5 from Light and Wayne fll^ and it allows the space X to be 
embedded in the continuous functions C^^'^ where k is the largest integer such that k < pi + 6 — d/2 
(Theorem 2.18), and the basis distributions of order 9 to be continuous functions C'^' where j is 
the largest integer such that j < 2{n + 9) — d (Theorem 3.14). Property B3.5 allows these weight 
function properties to be more easily compared with the 'extended ' properties given below. 



Light and Wayne's weight function properties were designed to generate the positive order radial basis 
functions and the aim of this section is to extend Light and Wayne's weight function properties so that 
they can generate positive order tensor product basis functions and also to formulate the weight function 
properties in terms of integrals. 

In Chapter 1 Williams [22] a class of weight functions, which I called the extended B-spline weight 
functions, was used to illustrate the weight function properties and the basis function theory. In this 
document a class of weight functions which I will call the extended B-spline weight functions of positive 
order is used to illustrate the weight function properties and the basis function theory. 

In more detail, the extended weight function properties given below in Definition H] were formulated 
by taking the following considerations into account: 



1.2 An extended class ol positive order weight lunctions 
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1 1 was interested in properties expressed in terms of integrals. Also, these properties should be scalable. 

d 

2 When a function wi defined on M} has the weight function properties every tensor product Y[ wi (xi) 

should also have these properties but perhaps for different parameter values. Now suppose u; is a tensor 
product function of the 1-dimensional function wi i.e. 

d 

w{x) ='^wi{xi) , xeW^, 

i=l 

and suppose that wi has Light and Wayne properties A3.1 and A3. 2. Now we want w to be a weight 
function i.e. satisfy A3.1 and A3. 2. In general this is not possible since if wi is discontinuous at zero then 

d 

w is discontinuous on the closed set [J {x : Xi = 0}. This motivates extended weight function property 

i=l 

WI of Definition [3] i.e. there exists a closed set ^ C IR.'' of measure zero such that w e C(°) (M''\yl) and 
w; > on R'^XA. 

3 I want to generalize the zero order extended B-spline weight functions studied in Chapter 1 Williams 
|22j to the positive order case. This will mean allowing basis functions with Fourier transforms which 
have zeros outside the origin i.e. weight function with poles (discontinuities) outside the origin. Indeed, 
the one-dimensional hat function is defined by 

and in higher dimensions it is defined as the tensor product 

d 

A{x) = '[[A{xi) , xeR"^. (1.4) 

i=l 

It is well known that 

A(0=riA(e,) = (2.)-^/^nf5^^^)', esM^. (1.5) 

The zero order extended B-spline weight functions were created by generalizing the right side of 11.51 
to the two-parameter class of functions 

^=n^' -'^^1' (1-6) 

and then restricting the choice of parameters I and n. The positive order weight functions will involve 
a different choice of these parameters. Here Xjw has zeros outside the origin on a closed set of measure 
zero. 

4 Property A3. 4 is 1/w S L\^^ and so is already defined by an integral and this becomes extended 
weight function property W2.1 of Definition^ Property A4.4 states: there exists /i G and i?, Cr > 

such that — — — < Cfl|x|^^^ for \x\ > R. Now Lemma [501 requires that 1/w G 5" i.e. 1/w be a tempered 
w[x) 

distribution (Appendix lA.5|) and from part 2 of Appendix l A. 5 . 1 1 we see that A3. 4 and A3. 4 imply that 1/w 

is a regular, tempered distribution. Further it is clear that extended property W2.2 i.e. J — rras" < oo 

\-\>r2 

for some a > and r2 > 0, combined with property W2.1 also implies that 1/w G S'. Happily, property 
W2.2 is a good substitute for property A3. 4. 

5 Some clarification of the relationship between property B3.5 and the new properties W3.1, W3.1* 
and W3.2 will be provided by Theorem [H] in Subsection 11.2.41 



1.2.3 The extended class of positive order weight functions 
The weight function class of Light and Wayne will be extended as follows: 
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Deflnition 4 The weight function properties 

The properties are defined with reference to a set A C which is a closed set of measure zero. The 
weight function is a mapping w : R"* — > R which has at least property Wl: 

Wl w e C(°) {W^\A) andw>0 on R'^XA. 

Property Wl will be used to define the semi-inner product distribution space for positive integer 
order 6. This property is identical to the zero order weight function property Wl (Definition\^ 
above). 



W2 Property W2 is satisfied if the following two sub-properties are satisfied: 
W2.1 1/w e Ll,. 

W2.2 J — rras" < for some fi > and r2 > 0. 

\-\>r2 

Property W2 is used to prove completeness and C°° density results regarding the spaces, as 
well as allowing the definition of the basis distributions. Condition W2 is satisfied iff the function 
A defined by: 

A(x) = ( 0' 1"'^;^' (1.7) 
^ ' \ a, r2 <\x\, ^ ' 

dx 

satisfies J 2\(x) ^ '^^^ function A is useful for the concise expression of integral in- 

w (x) \x\ 

equalities involving weight functions e.g. Lemma [^El 



Now to introduce properties W3.1, W3.1* and W3.2. These will allow the X^ spaces to be contin- 
uously embedded in the continuous functions and the basis distributions to be continuous functions. 
We call W3.1* the strong version of W3.1. Suppose 6 > 1 is a positive integer and k > 0; 



W3.1 w has property W3.1 for order 6 and parameter k if there exists a multi-index a such that \a\ = 9 
and 

W3.1* w has property W3.1* for order 9 and k if it has property W3.1 for 9 and k and all a such that 
\a\ = 9. 

W3.2 w has property W3.2 for order 9 and n if there exists r^ > such that 

l2t 

X 

dx < oo, < t < K. 



vu (x) \xf^ 

|2:|>r3 



W3 Ifw has property W3.1 or W3.1* or W3.2. 
Remark 5 



1. This definition permits the weight function to have discontinuities outside the origin on a 
closed set A of measure zero. This allows the Fourier transform of the basis function to have 
zeros outside the origin. For example, the extended B-spline tensor product weight functions 
introduced in Subsection \1.2.^ will generate basis functions which have zeros outside the origin on 
a set of measure zero. 

2. The extended properties have been framed with a desire to use integrals to formulate properties 
which generalize Light and Wayne's properties. 

3. Like the Light and Wayne properties A3. 3 and A3. 4, the extended properties W2.1 and W2.2 ensure 
that 1/w is a regular tempered distribution (or generalized function of slow growth) as per 
part 2 of Appendix \A.5.1\ 



1.2 An extended class ol positive order weight lunctions 



9 



4- Properties W3.1 and W3.1* are designed for use with tensor product weight functions such 
as the tensor product extended B-spline weight functions introduced in Subsection \1.2.8l and the 
equivalent property of partS Theorem^may be even more suitable e.g. Theorem \13l 

With regard to point 2 of Subsection \772.2\ above, when a weight function wi defined on M} has any 

d 

of the weight function properties W2.1, W2.2, W3.1 every tensor product Y\ wi [xi) also has the 

i=l 

same properties but perhaps for different parameter values. 

5. Property W3.2 is clearly designed to handle radial weight functions. 

6. In one dimension properties W3. 1 and W3. 1 * are identical but in higher dimensions property W3. 1 * 
may be stronger that property W3.1. However, property W3.1* is easier to handle analytically but 
W3.1 will give better results. 

7. The expressions used to define properties W3.1 and W3.2 may look a little strange because we have 
not combined the exponents from the denominator and the numerator but these expressions 
allow direct comparison of the two definitions and point to important similarities between them. 
Also, if a weight function has property W3 for order 9 then we will only define the function spaces 

and the basis functions for this order. 

8. I turns out that Xf^ C CL'^J and G G CL'^^J so we shall sometimes refer to n as the smoothness 
parameter. 

9. Observe that all the weight function properties are scalable, w.r.t. both the dependent and 
independent variables. 

10. If we set 9 — in the definition of the extended properties we obtain a set of zero order weight 
function properties: property WI for the positive order weight functions is identical to the zero 
order weight function property WI of Definition Properties W3. 1 and W3. 1 * become equivalent 
(by Theorem^ to zero order property W2. Properties W3.2 and W2 are equivalent to zero order 
property W2. When 9 = positive order property W2 stays the same and ensures that 1 /w is a tem- 
pered distribution. It allows the definition of a zero order basis distribution which corresponds 
to the positive order distributions of Definition \44\ 

1.2.4 Relationships between the extended properties and Light and Wayne's weight 
function properties 

The next theorem justifies the use of the terminology extended weight function properties. 

Theorem 6 Suppose for parameters /i G and R > a weight function w satisfies properties A3.1 to 
A3. 4 of Light and Wayne's Definition\^ Then: 

1. w satisfies the extended weight function properties WI and W2 of Definition^ with A = {0}, when 
a > d — 2pL, (T > and r2 = R. 

2. Suppose w also satisfies property B3.5 for jj, and order 9 i.e. ^i + 9 > d/2. Then the weight function 
satisfies property W3.2 of Definition^ for order 9 and all k such that < k < ^1 + 9 — d/2. 

Proof. Part 1 Clearly A = {0} is a closed set of measure zero. It is also clear that w has properties WI 
and W2. Now to prove property W4. Property A3. 4 requires that for some R> 

^— < Cfilxr^^, when \x\ > R. 
w(x) 

Regarding the definition of property W4, choose a > d ~ 2/i, cr > and r = R. Then 

/dx f dx 

|a;|>r |a;|>r 

since a + 2/x > Thus w has property W4. 



x^^'' dx f dx t "^^ dx f dx 
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Part 2 Choose any r' > 0. Then, since w has property A3. 4 

/\xf''dx f 

But the condition < k < ^ + 6 — d/2 imphes iJ. + 9 — k > d/2 and so the last integral exists. 

1.2.5 Equivalent criteria for properties W3.1, W3.1* and W3.2 

Theorem 7 The following three criteria are equivalent to weight function property W3.1: 

\x?^ 

1. f y , , dx < oo, < A < K. 

•' x^'^w{x) ~ ~ 

\x?^ 

2. f ' \ , dx < oo, A = 0, K. 

•' x^^'wix) 

3- f — ' , , < oo, t = 0, K and i = 1, . . . ,d. 

■' x^^wix) 



Proof. Part 1 Use the identity \x\^^ — 



/3! 
\/3\=9 

VaTt 2 A simple proof is obtained by splitting the domain of integration about \x\ = 1. 
Part 3 Since s > implies there exist constants Us, bs > 0, independent of x, such that 



i=l i=l 

this part is clearly equivalent to part 2. ■ 

Remark 8 The previous theorem clearly also applies to weight function property W3.1* where we assume 
the inequalities are true for all a satisfying \a\ = 9. 

Theorem 9 The following criteria are equivalent to weight function property W3.2 for order 6 > land 
K > 0; 

I^iSCk-LkJ) 2/3 

1- I ,20 , , < l/3| = L«J- 

|x|>r3 \X\ W[x) 

\x\>r3 \X\ W[X) I l,...,a. 

Proof. Part 1 is proved by using the identity 



2.^|^|2(«-W)|^|2W ^|^|2(«-LkJ) ^ M^2/3^ ^ M |^|2(- L-^J ) ^2/3^ 

l/3| = L«J l/3| = L«J 



and part 2 is proved by applying the inequalities, 

^ X] x'k' < kl ^ < J2 ^ < J? < 1, with p = K — [_k\ to the criterion of part 1. ■ 
fe=i fe=i 

1.2.6 Relationships between the extended weight function properties 

The next result demonstrates some relationships between the weight function property W2 and properties 
W3.1 and W3.2. 

Theorem 10 Suppose w has weight function property Wl. Then: 
1. Property W3.1 implies property W 3. 2 for any ra > 0. 
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2. Property W3.1 implies property W2 for any a > 6 and any r2 > 0. 

3. Property W3.2 implies property W2.2 for a = 9 and any r2 > r^. 
4- Property W3.1* implies property W3.1. 



Proof. Instead of property W3.1 we use the equivalent criterion of part 1 of Theorem [7] i.e. there exists 
Part 1 Choosing any r^ > Q 



a multi-index a satisfying \a\ = 9 such that / j^'^L^al < oo for all < t < k. 



^''''^^ ^ dx< I '^'! dx^^ ! -^^dx 



w{x)\x\'' J w{x) Y: " J w {x) ^,x^'- 9\ J w{x)x^^ 

\x\>r3 |a;|>r3 kl>i'3 k|>r3 

< oo, 

by property W3.1. 

Part 2 We prove properties W2.1 and W2.2. Suppose K is compact. Then for some r > 0, if C i? (0; r) 
and 

dx f x^^dx ^ P \x\^^ dx ^ 20 f '^^ 



w (x) J w (x) x^" J w {x) x^" J w (x) x^" 

The last integral exists since w has property W3.1. Thus — £ L]^^. 

We next show that W2.2 is true for a = 29 and any r2 > 0. In fact, the identity = ^ ^x'^ 

1/31=9 

implies \x\^^ > ^x^", and so 

dx al f dx 

< 



\xfwix) ~ e\ J x-^-^wixY 

\x\>r2 |2;|>r2 

The last integral then exists by property W3.1 with t = and (3 — Q. 
Part 3 By inspection of the integrals defining property W3.2. 
Part 4 Directly from the definition of W3.1* in Definition|H ■ 



1.2.7 Other general results 

The next result gives an integral which exists for all weight functions with property W3. 
Theorem 11 Suppose a weight function w has property W3 for order 9 and parameter k. Then 



w (x) \xf'^ 

|a:|>r4 



a^l^^ dx „ „, 

<oo, 0<S<K, (1.9) 



where r4 = if w has property W3.1 and r4 = r3 if w has property W3.2 



Proof. 



Case 1: w has property W3.1 Then r^ = Q and by part 1 Theorem [7] there exists a multi- index 



a such that \a\ = 9 and J J,^L < oo when < s < k. But the identity \xf^ = ^ of 

|a;|>r4 \a\=e 

part 5 Appendix 12421 implies ^x^°' < when a; 7^ so that ^ J J^j,.^^2c > / w(x)\x'\^'' ^^'^ 

|2:|>r4 |2;|>r4 

integral 11.91 exists. 



Case 2: w has property W3.2 Then rA = r^ and f ^, , '^.L < 00. But if < s < k then 

^ ^ I -to J w{x}\x\ — — 

|2;|>r4 



'^^ — f ,2(l-si ^^K, '^?iB < 2(i-si \ < 00 so the integral fL9l exists. 



J w(x)\xr J \x\^(-^) wix)\xfO - r42(«-») J w{x)\x\^ 

\x\>r4 I a; I > r4 I ^ I ^ ^4 
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1.2.8 The extended B- spline weight functions 

We will now introduce the extended B-spline weight functions. These are two-parameter, tensor product 
weight functions and in the next theorem we will derive necessary and sufficient conditions for a weight 
function to have property W3.1*. 

Theorem 12 Suppose d > 1, k > is real and 9 > 1 is an integer. For given integers l,n > the tensor 
product, extended B-spline weight function w is defined by 

d 2n 

^ sm Xi 

Then when d — 1 there exists a closed set Ad of measure zero such that w is a function with properties 
Wl and W2. It also has property W3. 1 * for order 9 and k iff n and I satisfy 

n>n + l-9, l>n + 9. (1.11) 

When d > 1 there exists a closed set Ad of measure zero such that w is a function with properties Wl 
and W2. It also has property W3. 1 * for 9 and k iff n and I satisfy 

n>K. + l, l>n + 9. (1.12) 

Proof. Clearly for each parameter pair n there exists a closed set Ad of measure zero such that 
property Wl is satisfied. Further, since property W3.1* implies W3.1, by parts 1 and 2 of Theorem [TOl 
w has property W2 and so we need only prove property W3.1* i.e. for all a such that \a\ — 9 



xf 



(x) 



dx < oo, t — 0, k; i — I, . . . , d. 



Now 



xf^ , [ xf -r-f sin^' , TT /■ s^* sin^' s 



X^°'Ws (x) 



-dx= / ^TT ^dx = T\ / — — ds, 1.13 

and these integrals will exist 

iff they exist near the origin and near infinity, 

iff 2t + 2; - 2ai - 2n > -1 and 2n + 2ai-2t> 1 for t = 0,K and aU i, 
iff 21 ~ 2ai - 2n > -1 and 2n + 2ai - 2k > 1 for all i, 
iff K - n + 1/2 < Qfi < Z - n + 1/2 for alH, 
iff K — n + 1/2 < < Z — n for alH. 

If d = 1 then a.i = 9 and so w has property W3.1* iff 

K-n + l/2<9<l~n. (1.14) 

If d > 1 then the integrals II . 131 exist whenever \a\ = 9, 
iSn — n-\-l/2<ai<l — n for all i, whenever |a| = 9, and 

K~n+l/2<0<l-n and k - n + 1/2 < 9 < I - n, 
iSk — n + l/2<ai<l — n for all i, whenever \a\ = 9, and 

K — n + 1/2 < ai < I — n for a,; — 0, 9, 
iff K — n + 1/2 < a,; < Z — ri for all i, whenever |a| — 9, and 

K-n+l/2<0 and 9 < I - n, 

iff 

K-n + l/2 <0 and 9 <l -n, (1.15) 
an 11.141 and 11.151 imply 11.111 and 11.121 of the theorem. ■ 

We now show that better results may be achieved using property W3.1 i.e. for given parameters 9 and 
K a larger combination of values of n and / satisfy property W3.1 than W3.1*. However when 9 < d the 
results are the same. 

Theorem 13 Suppose w is the extended B-spline weight function ] l.lffl with parameters I and n. 

Then w is a weight function with property W2. It also has property W3.1 for given order 9 > 1 and 
n>Q iff n and I satisfy 

n > K + 1/2 — mina, ?>n-|-maxQ;, (1-16) 
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for some a such that \a\ = 6. 

Further, w satisfies property W3. 1 for order 6 and k iff 

n> K+l/2- l9/d\ , l>n + l+l9/d\, (1.17) 

and this corresponds to any of the permutations of the a = (ai) defined bv \1.18\ of the proof. 

Proof. For this theorem we use the criterion for property W3.1 of part 3 Theorem [7] i.e. there exists a 

x'^^ dx 

multi-index a such that lal = 9 and f — — — < oo for t — 0, k and i = 1, . . . , d. 

X'^'^W [x) 

Suppose that \a\ — 9. Then all the integrals J^^ ^-^ifh^ds must exist for t = 0,k, 

iff integral exists near zero and near infinity, 

iff 2a, + 2n-2t-2l <1 and 2a, + 2n - 2t > 1 ior t = 0, k, 

iS ai + n — t — I < 1/2 and ai + n — t > 1/2 for t = 0, k, 

iS ai + n ~ I < 1/2 and ai + n > 1/2 and ai+n^K~l< 1/2 and ai + n ~ k, > 1/2, 

iff 1/2 - n < tti < / - n -I- 1/2 and 1/2 - n + k < a,; < ^ - n + k + 1/2, 

iff 1/2 — n + K < mina and max a < I — n + 1/2, 

iff 1 — n + K < min a and max a < I — n, 

iff n > 1 + K — min a and I > n + max a, 

which proves fl. 161 

Next we want to show that n and I satisfy property W3.1 iff they satisfy fT.17l i.e. iff they satisfy IT. 161 
for a given by 

l+[9/d\, 1 <^<rem(0,d), 

[9/d\, Tem{9,d) <i<d, ^ ' 

or any of its permutations. Clearly if n and / satisfy 11.171 they satisfy 11.161 for a given by 11.181 
The converse will be true if we can show that the a given by 11.181 simultaneously solve the problems 
max min a and min max a because this would mean that if a satisfies 11.171 then it must satisfy 11.161 If 

\a\=9 \a\=S 

l9/d\ — 9/d then these problems are clearly solved bv ll.l8l i.e. by ai — 9/d. Now suppose l9/d\ < 9/d i.e. 
rem(6',d) > 0. If min a > l+l9/d\ then \a\ > d + dl9/d\ = d + 9 ~Tem{9,d) > 9, and if max a < l9/d\ 
then \a\ < d [9/d\ = 9 - rem(0, d) < 9. Thus mina < [9/d\ and maxa > 1 + [9/d\ and so II. 181 solves 

both max min a and min maxa. ■ 

\a\=e \a\=e 

In Section 11.6.41 we will derive expressions for the basis functions of positive order generated by the 
weight functions of the last theorem. 



1.3 The spaces S^^^n related spaces 

We now define some key spaces and exhibit some of their properties. 
Definition 14 The spaces S'0 „ and C^^^ 

S^,o = S, S(^,^ = {(f)e S :D°'(f>iO) = 0, |a| < n} , n = 1, 2, 3, . . . , (1.19) 

and we endow 5*0 „ with the suhspace topology induced by the space S . S is the space of C°° functions 
of rapid decrease used as test functions for the tempered distributions. S is endowed with the countable 
seminorm topology described in Appendix \243\ 

C^o^C^^ C^:r,=^{4>eC^ ■.dU{0) = 0, m<n}, n=l,2,3,..., 
so the space retains the constraints of 5*0. „ near the origin. 

The next result gives a simple upper bound for functions in 5*0 „ near the origin. This follows directly 
from the estimate IA.5I (Appendix IA.8|) of the integral remainder term of the Taylor series expansion. 

Hx)\ < I ^ ||i?"^IL I , u e 50,„, X G (1.20) 

Noting that C^p is the space of C°° functions for which each derivative is bounded by a polynomial 
we will need the following useful results: 
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Theorem 15 

1. If f, g e Cg^p and^je S then fipeS and fg G C^p. 

3. For kj>0, (/) e C^fc and ij; e C^^ implies that (j)ip G C^^+r 

4. If\a\ = k then x" € C^f^. 

5. If k is a non-negative integer then \-\^^ E ^0°2fc' 

From Appendix 12391 we know that P„ be the space of polynomials of order at most n with complex 
coefficients, and P be the space of all polynomials with complex coefficients. 

Notation 16 Fourier transforms of polynomial spaces 

Pn^{p:pePn}, P = {p:peP}. 
The next theorem proves two relationships between the tempered distributions P„ and the functions 

Theorem 17 Suppose that n is a non-negative integer and u E S' . Then using Notation ] 161 

1. u E Pn iff [m, 0] = for all ip G 5*0. „• 

2. u E Pn iff 4>u — for all (j) G S'g „. 

Proof. Part 1 Suppose [w, 0] = for all G 50 „. This implies that the suppw C {0} and by a well 
known theorem in distribution theory, u E P. Thus u = p for some polynomial p. Suppose degp > n. 
For each \(3\ > n choose (jy^ G 5*0. „ such that i/)^ {x) — x^ / p\ in a neighborhood of zero. Then we have 
(^D"(f>p) (0) = Sa.fj and if the coefficients of p are 6^, 
[p, = [p{-D) ((/)^)] (0) = (-1)'''' bi3, and thus degp < n and u G P„. 

Conversely^ suppose u ^ P.^. Then there exists p ^ Pn such that u = p = (27r) p{iD)d. Hence, if 

4> e S'0^„ 



{271^ p{iD)S,(f> = {2n f [p{iD)6,(j)] = (27r)^ [p{iD)S,<j)] ^ (27r)' [S,p{-iD)(f>] 

= {27rf H-iD)^] (0) 
= 0. 



Part 2 Suppose that (pu = for all ip £ 5*0. „. Then for all V' € 5" 

[<pu, ^p] — [u, (p'ip] — [ipu, (j)] — 0, 

Thus [ipu, (p] = for all <p G 50 „ and so by part 1, i/m G Pn- Choose a point xq G M'' and an open ball 
containing a;o but not the origin. Choose ip € S ao that ip = 1 on this ball. Then u — tpu G Pn in this 
neighborhood and so u = in this neig hborhood. Thus u = on R''\0. Choose an open ball containing 
the origin and choose ip € S so that V' = 1 on this ball. Then u = ipu G Pn in this neighborhood and so 
u G Pn in this neighborhood, say u—p where p E Pn- But then p = on M''\0. Hence it = p on W^. 

Conversely, suppose u G Pn- Then, if G 50^„ and tp E S it follows that <p^ G 5*0. „. Thus by part 1 of 
this theorem [ipu, %p] = [w, <p'P'] = 0. ■ 
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1.3.1 The junctionals S'^ ^ 

The following lemma will enable us to define the space of continuous functionals 5*0 ^ which in turn will 
allow us to define the basis distributions in Section 11.61 and the operator J' of Section 11.4.31 

Lemma 18 

1. The space of rapidly decreasing functions S is a locally convex topological space when endowed with 
the countable seminorm topology defined in Appendix \243\ 

2. A linear functional f defined on a subspace M of the space S is continuous iff there exists an integer 
n > and a constant C such that 



\[fM\<c 



J2 (i + i-in^-v^i 

\a\<.m 



We write / G M'. 

3. Any continuous linear functional f on a subspace M o/ a locally convex topological vector space T 
can be extended non-uniquely to a continuous linear functional on T (f^ € T'). 

The set of extensions is + where is the set of annihilators o/M i.e. the members off 
which are zero on each member of M. 

Proof. This lemma can be proved, for example, by using the results and definitions of Chapter V., 
Volume I of Reed and Simon [T7] . ■ 
Recall Definition [H] of the space S(i, n- 

Definition 19 The spaces S'^ ^, n — 1, 2, 3, . . .. 

^ is the space of continuous linear functionals on S(i, „, where 5*0 „ has the subspace topology induced 

by 

The next theorem gives the criterion we shall use to prove that a linear functional on 6*0 „ is continuous 
i.e. is a member of S'^ ^. It also supplies the key extension result needed to define the basis distributions. 

Theorem 20 

1. A linear functional f on Si^ ^ is member of S'^ ^ iff for some integer m > and some constant 
C > 



< C 



J2 (i + Mn^-V'i 

|a|<m 



2. If f (z 5*0 then there exists £ S" such that — f on 5*0 „. The set of extensions is + Pn- 
We sometimes say that f can be extended to S as a member of S' . 

Proof. Part 1 follows from part 2 of Lemma fTHl with M ~ 5*0. „. 

Part 2 We use part 3 of Lemma [T51 when M — Sf^ „ and T = 5. In this case the the set of extensions 
is f^ + S^^ and g S S^^ iff g G 5" and [g, (j)] = for all (f) € S'0,„ i.e. 5 G ^ by part 1 of Theorem [T71 ■ 



1.4 The function spaces X^, 9 = 1,2,3,.. 
1.4.1 Introduction 

In Section 2 of [11] Light and Wayne introduced the reproducing kernel semi-Hilbert spaces X to for- 
mulate the minimal seminorm interpolation problem. The space X was defined using a positive weight 
function w and had positive order 6. In fact, the spaces X can be described as Beppo-Levi spaces [3] 
generalized using a positive weight function. In Section [1.41 we extended the class of weight functions to 
include functions which were positive and continuous except on a set of measure zero. In this section we 
will use the same definition for our function spaces as Light and Wayne but I will use the notation X^ 
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for the X spaces of positive order 9 generated by the weight function w. Only weight function property 
Wl is required to define . I will also introduce an alternative definition that I have found quite useful. 

By analogy with Sobolev space theory mappings will be constructed between X^ and in order to 
prove various properties of X^. To prove that is a semi-Hilbert space we construct the mappings 
X : X^ and J : l? ^ X^ which are adjoints, inverses and isometric isomorphisms in the seminorm 

sense. Here weight function property W2 is also required. Finally we prove some smoothness results for 
X^ when the weight function has properties W2 and W3. 

Definition 21 The semi-inner product spaces X'^ of order 9 ^ 1,2,3,.... 

Suppose w is a weight function i.e. it has property Wl. We now define X^, by 

Xi ^ !^f e S' : D^f e Ll, {«") , J w \D^f\' < oo for all \a\ = , (1.21) 
and endow with a semi-inner product and seminorm (part 3 Theorem[ 
(f^9)^,e = E ^D^fD^a, \fL,e = ^{U). 



iw,e- 



(1.22) 



To prove that X^^ is non-empty we need the following lemma: 
Lemma 22 Let J- he a set of points in . Then for any rj > there exists a function such that: 

1- fn e 

2. 0<f„ (x) < I, 

3. fn [x] = 1 when x G Trj, 
4- fri (x) — when x ^ J-3n- 

Here J-jj and J-^jj denote rj— and 3r]~ neighborhoods of the set J-', as defined in Appendix \241\ 
Proof. Choose 77 > 0. There exists a moUifier uj G satisfying 



suppw C B(0;1); = 1; 



UJ>0. 



Now define the scaled function oj,^ (x) = ij^'^lo (x/77) and let X2r) be the characteristic function of the set 
!F2ri- Then it can be shown that the function {x) — J X2ri iv) (■^ ~ u) ^he required properties. 

■ 

Theorem 23 Suppose the weight function w has property Wl w.r.t. the set A. Then 

^ -.ueC^ and suppwcR'^\(ylU{0})| C X^, (1.23) 

and the set on the left is non-empty. 

Proof. If ^l is an open set we define (fJ) = {0 € : suppt/) C fi}. A weight set is a closed set of 
measure zero so S = ^ U {0} is a closed set of measure zero. Then there exists r/ > such that the open 
set W'-\Bjj is non-empty where is the neighborhood set of B defined by rj. 

We now use Lemma [22] with T = B to show the set on the left of 11.231 is non-empty. Fix ?7 > 0. Then 
there exists a function with properties 1 to 4 of Lemma [22l Therefore, v E implies (1 — /^) v e 
and (1 - /^) u = on B,, i.e. (1 - /,,) v C Cf^ (W^XB). We conclude that the set on the left of fL23l is 
non-empty. 

To prove the inclusion [TH holds let / = (^-^^ where m e (M'^\6). Because e S it follows 

that ^ e (M'^\S) and ^ G (M^6). Thus / e S' , Cf^ Cj^ ^ ^Ic and Jw\-f \f\^ = 
/ w But w e C'-°^ (R''\.4) so u; e C*-"^ (R''\S) and so, = wuu is continuous on suppu. 

supp It 

This means that J w \u\^ < 00 and so J w\-\^^ f 

supp u 



< 00. We conclude that f £ X^ 



1.4 The function spaces X" , = 1, 2, 3, .. 17 

1.4-2 Some properties of 

The space is obviously contained in the space 

|/ e S" : e Ll^ whenever \a\ = 6i| . (1.24) 
We will now prove some basic properties of this space of tempered distributions. 
Lemma 24 The functions in the space fO^ have the properties: 

^. /eLL(K'\0). 

Define the function fp a.e. on M.'^ by: f f — f on K''\0. 
Then \-f fp G L\oc ^''^d ^" fp G Lj^^ when \a\ — 6. 
5- Cfp = Cf a.e. 

Proof. Part 1 is proved by using the identity of part 9 of Appendix 12421 to write 

ICI f {C) — \ E ~rC^" /(C)- Parts 2 to 4 have easy proofs and these have been omitted. However, 



some readers may find the definition of the the function fp in part 4 confusing. The function fp is not 
a function on in the distribution sense i.e. it is not an L]^^ {W^'^ function. It is a function in the 
elementary sense which happens to be a member of L]^^ (R'^\0) and being a member of L]^^ (R'^\0) 
defines a function a.e. on IR''\0 which defines a function a.e. on W^. 

Part 5 True since CIf e Ll,, Cf ^ ^L. Cfp = Cf on R'*\0 so Cfr = Cfa.e. m 

The next theorem derives some properties of and of the function fp defined in part 4 of the 

previous lemma. The proof of the formula [1.251 for |/|^ g reveals the motivation for using the coefficients 

^ to define the seminorm g. This formula will prove very useful because of its algebraic simplicity. 

Part 2 of the next theorem provides a way of verifying that a function is in X^ by making use of this 

formula. 

Theorem 25 Suppose w is a weight function i.e. w has property Wl. If f & X^ for some integer 6 > 1 
then f e Lj^^ (IR''\0) and we can a.e. define the function fp : ~^ C by fp — f on M'^\0. Further: 

1. The seminorm ri.22\ satisfies 

I ^i-ri/Fi' = i/i^,,. (1.25) 

2. An alternative definition of X^, is: 

X^^l^feS': Cfe Ll, tf \a\ ^9- jw \fp\' < cx^j . (1.26) 

This definition actually makes sense because by part 2 of Corollary ^^^the condition Cf G L^^^ for 
all \a\ = 9 implies that f € Lj^^ (R'*\0), and so fp can be defined a.e. on R''. 

3. The functional H^, g is a seminorm. In fact null \ -\^ g = Pe o,nd we also have X^ O P — Pg. 

Proof. Part 1 Since fp is the function defined in part 4 of Lemma [24] we have from part 5 of the same 
lemma that Cfp e L.^ , C"/ e Lie and Cfp = T/ a.e. Hence 



^lf'l/F|' = 



\|a|=e / \a\=e \a\=B 



E 



\a\=B 
|2 



W 



1 

Cf 



2 
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since / S X^^ . 

Part 2 Now let U be the space defined by the right hand side of equation 11.261 

Step 1 Prove that C U: By part 1 of this theorem, if / e X^ then / w |/f|^ = < 
Also, f Xl imphes / e L\^^ {W^\S) and the other requirements for / to be in U follows from Lemma 



Step 2 Prove that U C X^: Assume / e U. We need to show that, I] ~r / 



|a|=e 



< oo when 



6. But from the proof of part 1, = ^"/i? £ L]^^ and so 



E 

\a\=9 



w 



\a\=e 



w 



|a|=e 



W \CfF 



E 



6'! 



|a|=e 



Part 3 Suppose that |/|^ g = 0. Then / e S", Z)"/ e L^^ for |a| = 6*, and so 



i/i: 



E- 

^ a! 



Now ui > a.e. implies that when \a\ = 9, D°'f = a.e. and hence -D"/ = a.e. But by a well known 
result from distribution theory e.g. corollary to Theorem VI, p. 60 Schwartz we can conclude that 
/ e Pe- Finally, it is clear that f £ Pe implies \f\i^g~0. Thus we have proved null |-|^ g = Pg. 

Clearly Pg C Xf^ n P. To prove the converse, suppose / G X^ n P and f ^ Pg. Then |a| = 6* implies 
D"/ e F\0 and ^ L^^, but f £ X^ which implies £ L]^^, a contradiction. Thus X^DP ^ Pg. 
■ 

The function fp, introduced in the previous theorem, is of central importance to the theory of this 
document. We now derive some important properties of this function. To do this we need the following 
lemma: 

Lemma 26 Suppose the weight function w has property W2. Then for any integer > I there exists a 
constant Cr2,e independent of 4> £ Sij^ g such that 



:/ 



1/2 



,26 



< Cr 



1 



1/2 



|2A(- 



E iKi + i-ir^^ 

I a I < n 



where n = ceil {0,tT} — ceil max {0, cr}. Here X is the function introduced in the definition of weight 
function property W2. 

Proof. Suppose r2 is the parameter in the definition of weight function property W2. Then for (j) £ Si^^g 
we write 



,20 



< 



,26 



,26 



\-\<r2 



\-\>r2 



I T,, 



1 



\-\<r2 



< 



,26 



\-\>r2 
1 



,26 I ,2a 

W • 



,2a 



h max 

W \-\>r2 



,26 



'\-\<r2 



\-\>r2 



< 



h max 

W \\-\>r2 



'\-\<r2 



M>'-2 



< max ■ 



, max 

M>r2 



|2A(.) ■ 



(1.27) 
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which exists by weight function property W2. Since n — ceil {9, a} we can apply the inequality II. 201 to 



get 



\a\=0 \a\=0 \a\<n 



and, since cf) € S 



max 

M>'-2 



<r^ymx{\-n<l>\)<r^'\\{l + \-\r<l>\U<r^' E 11(1 + 1-1)"^^ 

\-\>r2 /-^ 

\ct\<n 



Substituting these inequalities into the right side of 11.271 gives the estimate of this lemma where 

Cr2,e = niax { 1, Tj"^} . (1-28) 

Finally, by part 1 of TheoremdOl ( / e S'^^^- ■ 



Theorem 27 Suppose f e X^. We define the function fp by: fp — f on R'^\0 and fp (0) = {0}. Now 
suppose the weight function w also has property W2. Then fp has the following properties: 

1- fF^OtJJfePe. 

2. fp E S'^Q with action j fp(j), (f> G 50 ^. Also fp = f on Siji^g. 

3. For any compact set K 



fF< 



K 



/ - 1^1 



< oo. 



4- If r2 is the parameter in the definition of weight function property W2.2 

1/2 

l/L,e<oo- 



\fF 



i.i>.. (i + i-ir 



< 



1 



\-\>r2 W\-\ 



5. \-f fp is a regular tempered distribution in the sense of Avpendix \A.571\ Further, if \a\ = 6 then 
O'^so a regular tempered distribution. 



Proof. Part 1 By parts 1 and 3 of Theorem HSl /f = iff |/|^ ^ = iff / G 

Part 2 First we show that J fpf/) exists for </> e 5*0 g. By part 1 of Theorem [ 
\f\l,e ^ |/F|^ so for e 50,e 



< 



w\r\fF\ 



<\fi 



w 



y/w\-f fp G L'^ and 



1/2 



w 



,20 



having used the Cauchy-Schwartz inequality. By Lemma [2 

,2 \ / „ ^ \ 1/2 



w 



,26 



< Cr 



1 



|2A(- 



E 11(1- 

|a|<7i 



•ir^"0ij 



where n = ceil {0, a} and A is the function defined in weight function property W2. By Theorem 1201 
this inequality implies fp € S'^ g. 

Now to show that fp — f on Sijj g. Since fp £ S'f^ g Theorem 1201 implies fp has a non-unique extension 
/|, to S'. Define g = {fl^Y G S' . Next we want to show that g G Xf^. In fact if |a| = 6* and G S* 
then, since G ^0,^, [C9,4>] = [C f'pA] = [f'p^C^] = [fF,C4>] = [CfF^cj)] and so C9 = CfF. But 
^"/f G L]^^ by part 4 of Lemma which means that ^"g G L\^^ and hence by part 2 of Lemma 
that g G L]^^ We can now define the function gp hy gp — g on R''\0 and gp (0) — 0. Now if 

(t> £ (K'^\Q) then G 6*0,9 and it follows that [gp,(p] = [/J^, 0] = [fp.cj)] i.e. gp = fp a.e. on R''\0 
and hence gp = fp a.e. on W'-. Thus \g\^ g = \f\^ g and so g G X^. Further {g — f)p = and therefore 
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g — / e Pe by part 1. Finally, by Theorem [T71 u e Pg iS [u, (j)] = for all (j) £ Si^^g. Hence g = f on Sq, 



so that for d £ Sa 



f, 



[di 0] = [/f, 0] = [/f, 0] so that f ^ fp on S'g^e, as required. 



Part 3 If is compact then by using the Cauchy-Schwartz inequality 



K K \K / \k / \K 



1/2 / s 1/2 / ^ 1/2 



^i-ri/i^rl =l/-l i/U< 



1 



since weight function property W2 implies that w e L\^^. 
Part 4 Using the Cauchy-Schwartz inequality 



M>r2 (1 + M)" J\-\>r2 IT J\-\>r2 



< { I ^IT'I/fI 

M>r2 















J\-\>r2 Wlf" 1 



1/2 



1/2 



— \f\w,e \ I I |2(T 

'|.|>r2 W \-\ 



< OO, 

since w has property W4. 

Part 5 That |T/f is a regular tempered distribution follows immediately from parts 3 and 4. If 
|a| = 6 then I^^^/fI < |T I/f| and so ^"/f is also a regular tempered distribution. ■ 

Corollary 28 Suppose the weight function w has property W2, and suppose f E S' , f E Lj^^ (R''\0) 
and J w < oo, where fp was defined in Theorem \2T\ Then: 

1- fF = OtfffeP. 

2. fpES'f^g with action j fpi'j 4> ^ S^ji q. 

3. /f has properties 3 and 4 of Theorem \27\ 

4- /f has property 5 of Theorem \27\ i.e. \-f fp is a regular tempered distribution and^^fp is also a 
regular tempered distribution when \a\ —6. 

Proof. Part 1 Since S' cV, fp = implies f E V and supp / = {0} which implies f E P. Conversely, 
f E P implies f E S' and supp / = {0} i.e. fp = 0. 

Parts 2 to 4 follow from an examination of the proof of Theorem [271 ■ 

The last corollary allows another definition of the space when the weight function has property 
W2. 

Corollary 29 Suppose the weight function w has property W2. Then as sets 

Xt = |/ e 5' : fE Ll, (M^O) , j w\-\^' |/f|' < cx), and \a\ = 9 implies Cf^ Cfp on , 

(1.29) 

where fp : C is the function defined by fp — f on M.'^\0. 

This definition makes sense since by part 4 of Corollary \28\ the first two constraints imply that fp^S'^g 
and when \a\ = 9, ^"fp is a regular tempered distribution in the sense of Avvendix \A.57l\ with action 

JCfF(t>,^eS. 

Proof. Definition of is 

|/ e 5' : r/e Ll, if \a\ ^9; J w\-f \fp\' < ooj . 
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Suppose / is a member of the the right side of 11.291 Since w has property W2 part 4 of Corollary [55] 
implies that when \a\ = 6, ^"/f is a regular tempered distribution in the sense of Appendix I A . 5 . 1 1 and 
so Cfp e Lie- But Cf = Cfp as distributions so C"/ G L^^ and thus f € X^. 

On the other hand, ii f G then by part 2 of Theorem [ISl /€ L}^^ {R'^\0). Further, by part 2 of 
Theorem 1271 fp^^S^g and fp = f on StD^. But Theorem 1151 implies ^"'0 G •S'g.e when \a\ — 6 so that 

f — fp on 5, and we have shown that / G implies / is a member of the right side of 11.291 ■ 

Remark 30 A word of caution about definition ] 1.29\ of X^. It is clear that f E S' and f G Lj^^ (M''\0) 

imply that fp exists. Further, the conditions f G S' , f G Lj^^ (lR'*\0) and J w |-|^^ |/f|^ < oo automati- 
cally imply that fpES'q^g and S,"' fp G S' . 

However, if we prove that f E S' and f E Lj^^ (R''\0) so that fp is defined, and then try to prove that 
\a\ — implies = fp on S, we will first have to show that fp G S' . There is a question of order 
here. 



1.4.3 The operators X : ^ L"^ and J : L'^ ^ 

In this section, by analogy with the study of Sobolev spaces, we will define inverse, isometric operators 
(in the seminorm sense) between X^ and for > 1. In the next section these operators will be used 
to prove the completeness of X^, again in the seminorm sense, without referring to any other space such 
as X^. If the weight function also has property W2 these mapping will turn out to be, in the seminorm 
sense, adjoints, inverses and isometric isomorphisms. It is the properties of these operators that count 
and the reader can avoid their definitions and the associated lemmas and just study the properties given 
in Theorems |32l |H1 and El 

Definition 31 The operator I : X^^ L'^, 6* = 1, 2, 3, . . .. 

Suppose that the function w has weight function property Wl. Using the definition of Xf^ given in part 
2 of Theorem \25\ we define the linear operator I : X^ — > by 

If=(V^\-ffpY. (1.30) 



where the function fp is defined by: fp — f on M.'^\0 and fp (0) = {0}. 
Theorem 32 Properties of I: 

1. I is an isometric mapping from X^ to I? in the seminorm sense. 

2. nuUX^Pe- 

Proof. Property 1 From part 1 of Theorem [25] we have 
\\^f\\2 = \\V^\-ffp\l^\f\u,e- 

Property 2 Now X/ = iS^/^\-f fp = OiSfp^ 0. But fp^OiSfEPehy part 1 of Theorem[171 

■ 

The next step is to construct an inverse of T, which we will denote by J" and this will require the 
theory of the spaces ^ and S'^ g discussed above in Section [Ol We will be looking for an operator 

which makes rigorous the formal operator ^-^^-p-^ , g E L^. To justify the inverse-Fourier transform 
we show that -E, ,„ E „ and then extend ,a to as a member of S" . This operator from to 

S' will become our inverse operator J : L'^ ^ X^. We start by showing (^—^^^^ ^1$ e when g E L"^ . 
Choose (f) E S([,fi and apply the Cauchy- Schwartz inequality to obtain 





Now observe that by Lemma J Jj^jag ^ G 5*0 ^ and so ^^^o ^ 'S'g Theorem now allows us 
to extend the functional ^, to 5 as a member of S' . We can now define the operator J. 
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Deflnition 33 The operator J : S' , > 1. Suppose that the weight function w has property W2 



and g £ L . Then 



G 5*0 g . Hence by Theorem \2(A this functional can be extended (up to a member 



of Pg) to S as an element of S' , say f . Now define the class of mappings : S' by 



Jg = /• 

Note that J is not linear but the next theorem shows it is linear modulo a polynomial in Pg . 
Theorem 34 Properties of J : 

2. J : L? ^ Xf^ and is an isometry in the seminorm sense. 

3. J is linear modulo a polynomial in Pg i.e. 

J (Ai5i + A252) - >^iJgi - ^2Jg2 e Pg. 

I Jg^Pe iffg^O. 

Proof. Properties 1 & 2 To prove Jg G we use the definition of X^ given in Corollary [29] i.e. 
Jg £ S',Jge Ll^ (K'^\0), and for {Jg)p defined by: {Jg)p = Jg on K'^\0 and {Jg)p (0) = {0}, it is 



required that J i 



,261 



KJg)F\ < °° and CJg = C {Jg)F on S when |a| = 



From the definition of Jg we have Jg 



on and \i K d R'^\0 is compact 



< 



\g\ 



1/2 



Ik ^/w\-\ \jk 
Since G we have dist (0; K) > and so 

1 

< 



1 



1/2 



K w |-| 



26 



< 



1/2 



K W 



,26 



< 00, 



because 1/w G Lj^^ by weight function property W2.1. We now have {Jg)i 
property 1. Next 



which proves 



\Jg\l,e^ J y^\-\''\iJg)F\' = J 









9 











l|2 ^ 

I.9II2 < 



so that J is isometric. Now if \a\ — 9 and tp £ S then ^"V' G S^i^g by Theorem [TSl and since the 
operator J was defined by extending ^^,^6 ^ g from Si^^g to S* as a member of 5" it follows that 



so that CJg = C {Jg)F on S, confirming that Jg £ X^ 
Property 3 If (j) £ Si^^g then 



[{J (Ai5i + A252) - XiJgi - \2Jg2T , 
Part 2 of Theorem 1171 gives the required result. 



Ai.gi + A2.g2 A151 



A252 



w 



w 



= 0. 



Property 4 The details of this proof are very similar to those of the proof of part 2 of Theorem 
Suppose Jg £ Pg. Then {Jg)p = 0, \ Jg\^ g = ^ and thus \\g\\2 — which implies 5 = 0. The argument 
is easily reversible. ■ 

Having proved some properties of I and J we now study how they interact: 
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Theorem 35 Suppose the weight function w has property W2. Then for 9 > 1 the operators I : — )■ 
and J : l? ^ X^ interact as follows: 

1. {JIf )p = fp when f e X^. Also, JT : X^ X^ is an isometry in the seminorm sense. 

2. Jif-fePg. 

3. For all choices of J , XJ = I on . 

4-. T and J are adjoints in the sense that {J^g,f)^ q = {g,Tf^2- 

Proof. Part 1 From part 1 of Theorem [32] X/ = \fw\-f fp and from Theorem [Ml {Jg)p — y^~p'- 
Hence {Jlf)^ ^ ^ Rirther, \JIf\l^, ^ i ^Y?' \{JIf)p? /^if Uf? = \f\l^e- 

Part 2 From part 1, JIf - / e and {JIf - f)p = 0. But by part 1 of Theorem [HI this imphes 
that^X/-/ePe. 

Part 3 Suppose 5 G Then Jg £ X^ and iJg)p = Thus 

iJ.f={V^\-f{J9)py=g- 

Part 4 

{J9J)^,e = j iJ9)plF^ jV^Vfgh^ J gV^\-f fp^ig,If),. 



1.4-4 The completeness of 

In this section, by analogy with Sobolev space theory, we use the operators T : X^ and J : ^ 

where > 1, studied in the previous subsection to prove that when w has weight function properties 
Wl and W2 the semi-inner product space Xf^ is a semi-Hilbert space i.e. it is complete in the seminorm 
sense. 

Light and Wayne [TT] do not define the operator J' : ^ X^ . They only define the operators T and 
J7 between X'^ and and their proof of the completeness of X^ uses multiple operators and spaces 
which correspond to each multi-index a such that \a\ — 9. In fact, in Definition 2.11 they define the 
semi-inner product spaces (Yq, given by 



Y^ = \feS':D^fe Ll 











and 


[ w 


D^f 


< 00 \ 



w D-f^, 



and show that : Yq, ^ X^ is onto and an isometric isomorphism, which implies each is complete. 
Then in Definition 2.14 they define their positive order semi-inner product space {X, |/|) by 



\a\=e \a\=e ' •' 



1 

D^f 



and argue in Theorem 2.15 that the completeness of each implies that Y is complete. 

So there are two ways to prove completeness and although the definition of may be difficult, the 
operators I and have nice properties and it is really only these properties that are important. 

Definition 36 Completeness in the seminorm sense 

Suppose that U is a linear space equipped with a seminorm | • | . We will refer to U as being complete in 
the seminorm sense, if to each Cauchy sequence {uj} C U there corresponds an element u G U such that 
\u — Uj \ as J —> 00. Note that u is no longer uniquely defined by the sequence {uj}. 

Theorem 37 Suppose the weight function w only has property W2. Then for 9 >1, X^ is complete in 
the seminorm sense of Definition\3(A 



24 
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Proof. First note that the operator J is not hncar. Here we use the results of Section fl .4.31 concerning 
the operators X and J . Suppose {/fc} is Cauchy in X^. Then {I/t} is Cauchy in I? since X is an 
isometry. Since L? is complete, X/^ —* g for some g G L'^. But JiXfk — g) & and since J is an 
isometry, \J (Xfk - g)\^ g = \Xfk - g]^ ^ 0. 

However, by part 2 of Theorem [35l J^Xf — f E Pg. so that 

\J i^fk - 9)\l,e - I Wfc - Jato - \fk - Jgll^e : 
and so fk J'g as fc cx). ■ 

The next corollary relates weight function property W3.1 to the completeness of X^. Here weight 
function property W3.1 replaces property W2. 

Corollary 38 Suppose the weight function w only has property W3.1 for order 9 > 1 and n > 0. Then 
X^ is complete in the seminorm sense of Definition \3(A 

Proof. By part 3 of Theorem [TUl property W3.1 implies property W2. Thus the conditions of Theorem 
[37] are satisfied and X^ is complete. ■ 



l.Ji^.S The smoothness of functions in 

This theorem provides information about the behavior of the Fourier transform of functions in X^, 
6 > 1. This information will be used to prove smoothness properties for X^ when the weight function 
has properties W3.1 or properties W2.1 and W3.2. 

Theorem 39 // a weight function w has property W2 then given f € X^ we can define a.e. the function 
fp ■ K-'' C by fp = f on M.'^\0. Now we have the following results: 

1. If w has property W3.1 for order 6 and k, then S,^ fp G when \(3\ < k. 

2. Suppose w has property W2.1 and also property W3.2 for order 9 and k. Choose p G such that, 
< p < 1; p (x) = 1 when \x\ < rg. Then, (1 - p) f fp G when \f3\ < k. 

Proof. Part 1 First note that by part 2 of Theorem [TO] property W3.1 implies property W2 and so 
fp is defined. Now by part 1 Theorem [7] property W3.1 implies that for some a satisfying \a\ — 9, 



i2A 



2a 



< oo for < A < K. So if < k, by using the Cauchy-Schwartz inequality, we obtain 



eh 



< 



|l/3| 



|l/3| 



w\e\\fF\< 



w\C\ 



I/f| = 



|2|/3| 



W ^ 



2a 



I/I 



where the last step used part 1 of Theorem [ 
W3.1. 



The term on the last line is finite since w has property 



Part 2 First note that, by part 3 of Theorem [TO] property W3.2 implies property W2.2. Hence w has 
property W2 and so fp is defined. 

Since /G i.L(K^O), {l-p)fp G and {l-p)efp G Lj, 
1^1 ^ '^s > 0, we can use the Cauchy-Schwartz inequality to write 



< 



|l/3| 



|(«-|/3|) 



\-\>r3 



Further, since p {^) = 1 when 

w\-\'\fF\ 



< 



1 



l/f 



w 



\>r3 




ri/Fi' 



w,e ■ 
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Since w has property W3.2 for order 6 and k, the last integral is finite. ■ 

This theorem corresponds to Light and Wayne's 111 , Theorem 2.18 and represents our main smoothness 
result for spaces. 

Theorem 40 Suppose the weight function w has properties W2. 1 and W3 for order 9 and k, as described 
in Definition^ Then 

Proof. By Theorem [TOl properties W2.1 and W3 imply property W2. Now suppose pp G C'o°i < pg 5; !> 
and po = 1 on the ball B (0; 1). By Theorem EH / e imphes (1 - Po) f ^ (1 - Po) If e 
when \P\ < [kJ. Hence ((1 - po) G c{j"^ for \(3\ < [kJ and so ((1 - pp) e 

We now write / = Pof + (1 ^ Pq) f- Taking the inverse Fourier transform of this equation yields 



f={pofy+{i^-po)fy 



The first term on the right is the inverse Fourier transform of a tempered distribution with compact 

'fp function. Thus / e C^p + C^^"^^ C d^p^\ ■ 



support and so by Appendix [M21 it is a C^p function. Thus / e Cfp + C c'^^^ 



Corollary 41 Suppose w is the extended B-spline weight function ] 1 . 1 U\ with parameters I and n. Then 
if w has property W3.1 for 6 and some k it follows that C C^p "'^+Lf/'^J)^ 

On the other hand, if w has property W3.1* for 9 and some k, it follows that X^ C C^p when 



d=l andX^C C^gp when d>l. 



Proof. From fOTl of Theorem [T31 if n and / satisfy property W3.1 for 9 and k then n satisfies n > 
K + 1/2 — l9/d\. Thus K = n — 1 + [9 / d\ is the largest valid integer value of k and so Theorem HUl implies 



^(n-i+Le/dj) 

^7,) '^BP 



When w has property W3.1* we employ a similar argument based on Theorem 1121 



1.5 The function — ^ 

In this section we will prove some properties of the function ^^^^2e i where u; is a weight function and 9 
is a positive integer, which prepare for the definition of the basis distribution and basis function in the 
next section. The results in this section study the functional J ^^^ae) ; G '5'0,2ej ^J^d show how it can be 

extended to a member of the tempered distributions S' . Note that the function ^y^2o was introduced in 

Subsection 11.4.31 where it was used to define the operator J : L'^ ^ X^ . 

We now prove some properties of the function ^y^2() where w is a weight function with property W2. 

The next result shows that ^^^^20 £ 20 ^^'^ '^iil allow basis distributions to be defined in the next 

section. Compare this result with a property of ^^^^20 that was proved in Lemma [26l 

Theorem 42 Suppose the weight function w also has property W2. Then the functional J ^^jj^w defined 
for (f> e S'0.20 is a member of ^e- /'Jct there exists a constant Cr2,e, independent 0/ (/> e 5*0 26*' such 
that 




(1.31) 



where n = ceil{0,cr}. Here A is the function introduced in the definition of weight function property 
W2, and Cr2,e — max {l, ^} is the constant in the estimate of Lemma\2^ 
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Proof. Suppose r2 is the parameter in the definition of weight function property W2. Then for (p e 5*0 
we write 



w 



,29 



,26 



,29 



\-\<r2 



\-\>r2 



I ,29 ,„ 



,2a 



,29 I |2(T 

W • 



\-\<r2 



|-|>'-2 



< 



,261 



h max 



= |-|<r2 



W \\-\>r2 \ |.| 



29 



W 



,2a- 



< max ■ 



,29 



,2a 



, max 



,29 



N>-2 V \.r I I J wif^^- 



|-|>'-2 
f 



(f.32) 



where the integrals exist by weight function property W2. Since n = ceil {0, cr} we can apply inequality 
[L^ to get 



— — M oo — M 

oo \a\=2e \a\=2e \a\<2n 



,29 



and, since cf) Cz S 



max 

\-\>r2 



<r2--max(|.ri0|)<r,-- (f + |. 

/ \-\>r2 



<r2'' E II (1 

\a\<2n 



s2n 



Substituting these inequalities into the right side of lf .321 gives the estimate [HM] of this lemma. Finally, 
part f of Theorem 1201 implies that the functional J ^y^2o defined on 5'0.2e is a member of 5*0 29- " 

The last theorem now allows us to extend f —rrrw to S* as a member of S". 

Corollary 43 Suppose the weight function w has property W2. Then the functional J ^jyjqw of Theorem 
[7^ is a member of S'g onrf can be extended from 80^29 to S as a member of S' , say x'^- The set of 
extensions is + P29 ■ 



Proof. A direct consequence of Theorem and Theorem [ 



1.6 Basis distributions and basis functions 

It is now time to define the (in general complex-valued) basis distributions that are generated by a 
weight function with weight property W2. However, it will be shown that if the weight function also has 
property W3.1 or properties W2.1 and W3.2 then the basis distribution is a continuous function that 
will be used in the later chapters to construct the basis function interpolants and smoothers studied in 
those documents. Following Light and Wayne 111] we will define basis distributions directly i.e. without 
reference to the variational problems which define the basis function interpolants and smoothers to be 
studied in later documents. 

We will also calculate the basis functions which correspond to the (tensor product) extended B-spline 
weight functions introduced in Subsection ll.2.81 



1.6.1 Definition of a basis distribution 

We first define a tempered basis distribution of positive order by only assuming weight function properties 
Wl and W2. Later property W3 will be applied and this ensures the basis distributions are continuous 
basis functions. 

Definition 44 Basis distributions and basis functions 
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Suppose the weight function w also has property W2. Then by Corollary \43[ x = 20 ^ 20 

w\-\ 

each positive integer 0, and can he extended to S non-uniquely as a member of S' which we denote by . 

If G Cz S' and satisfies G — > say G is a (tempered) basis distribution of order 9 generated 
by w. 

Thus a basis distribution of order 9 is any tempered distribution G which satisfies 



G, 



w\-\ 



for all (j) G 50^29- (1.33) 



For the purposes of this series of documents we will call a basis distribution a basis function if it is 
continuous. We note that usually we would call a tempered basis distribution a basis function if it were 
a regular tempered distribution in the sense of Avvendix \A.5~l\ 

From their definition basis distributions of a given order are not unique. In fact: 

Theorem 45 Suppose the weight function w also has property W2. Suppose G is a basis distribution of 
order 9 > 1 generated by w. 

Then the set of basis distributions of order 9 is G + P2e ■ 

Proof. This is a direct consequence of the definition of a basis distribution and Corollary l43l ■ 
The next theorem will require the following lemma which we give without proof. 

Lemma 46 Suppose {xkYl^i ^ °f distinct points in and {XkYl^i ^ °I complex numbers. 

n 

Then the function /{£,)= J2 AfcC""*^ has the properties: 

1. / (^) = a.e. implies Afc = for all k. 

2. The null space of f is a closed set of measure zero. 

Theorem 47 Suppose the points {xk}k=i are distinct. Then the translated basis distributions 
{G {■ — Xk)}^^i are linearly independent w.r.t. the complex scalars. 

n ^ 

Proof. Suppose J2 ^kG (• — Xk) = and not all Xk 7^ 0. Then the definition of G implies G — ^(^^^^^^20 
on R'*\0 and so on taking the Fourier transform 



= V Afce-"^«G = y XkC-^-i G ^ ^^^^ '^"^ 



29 ■ 



k=l \k=l 



a.e. on IR''\0. Hence, since w (^) > a.e., it follows that ^ AfcC"*^^* = a.e. and on applying Lemma 

fc=i 

3 we conclude that Afc = for all /c. ■ 



1.6.2 The smoothness of basis distributions; continuous basis functions 

In this subsection we look at the smoothness and growth of basis distributions when the weight function 
has either property W3.1 or properties W2.1 and W3.2 of Definition [D In the case of property W3.1 
we will also derive a simple inverse Fourier transform formula for the basis function and its (bounded) 
derivatives which only uses Fourier transform theory. When the weight function has property W3.2 
much more effort is required to obtain a 'modified' inverse Fourier transform formula and in Chapter [3] 
will deal with this. 

However, the next theorem will deal with the W3.1 case and it will require a lemma, a standard 
inverse Fourier transform result due to Laurent Schwartz. See, for example. Theorem 4.2, p. 150 of 
Malhavin [Ti] . 

Lemma 48 If f e S' and f e L^, then f e Cg^ and 

f {x) ^ {2^)-"'^ j e"«/(Ode- 
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Theorem 49 Suppose the weight function w has property W3. 1 for order 9 and smoothness parameter 



K. Then ^^^^2e S L^, G — {^ ^^^^20 ^ is a basis function of order 9 generated by w, and G G Cg'^'^ 
Further, the set of basis distributions is G + P20 and 



J) 



,20 



de, I7I < lsa^j . 



(1.34) 



Proof. By part 2 of Theorem [TO] w has property W2 and so the basis distributions are defined. By 
Theorem [HI G C 5'. Hence [-;;;^) e C^"^ C S' . Set G 



G = ~rm a-e-, implying G £ cj^^ and so G satisfies 



Then G e S' and 



G, ( 



w 



,26 ■ 



26 J 



and by Definition [44] G is a basis function. By Theorem [45] the set of basis functions is G + P20. 

Since w has property W3.1, part 1 of Theorem [TT] imphes that for order 9 and k, -^jj:^ € when 
< s < K. Hence 



D-'GiO = m'^GiO 



m) 



71 



< 



l7l 



e L\ |7| < L2^J , 



and applying Lemma [M] with / = D''G G S' we obtain [LM] and D'^G G g{j°^ for I7I < [2k\ i.e. 



i[2Ki) 
B 



GeC] 

Thus when the weight function has property W3.1 for order 9 and k, the basis distribution of order 
9 must have differentiability of at least [2kJ and each derivative is bounded. This is at least twice the 
minimum smoothness of the functions in , which have differentiability of at least [kJ . Continuous basis 
functions will be used to construct the basis function intcrpolants and smoothers which are discussed in 
Chapters [1 [5] and [U 

We will now consider the question of smoothness when a weight function has property W3.2. The 
next theorem shows that a basis distribution of order is a G^p^^'^ function. This is at least twice the 
minimum smoothness of the functions in , which were shown to have differentiability of at least \_k\ . 

Theorem 50 

1. If a weight function w has property W2 then l/w G S" H Lj^^. 

Now suppose the weight function w has properties W2.1 and W3.2 for order 9 and k. Then: 

2. If G is a basis distribution of order 9 then \'\^^ G — ^ as tempered distributions. 

3. Any f e S' such that \f^f^^ satisfies f G G^^l^^^K 

4- If G is a basis distribution of order 9 then G G G^p''^''. 

Proof. Part 1 Suppose weight function w has property W2. Noting that property W2 is defined by the 
conditions 

1 



M^2.1 : l/w G L}^^, W2.2 : / — ^ < 00 for some r2 > 0, 

J\-\>r2 W \-\ 



we calculate that 





< 2 max < 










'\-\<R2 wl-f" I 


J w 







where \a~\ denotes the ceiling of a. Hence l/w G 5', since (1 
used in Definition 12431 to specify the topology of S' . 



■eS, 



is one of the seminorms 
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Part 2 By part 4 of Theorem [TUl w has property W2 and so the basis distribution is defined and by 
part 1, l/ui e S' . If e then by Theorem [151 \'\^^ 4> G 50^261 and so by 11.331 of the basis distribution 
definition 



,29 



G, ( 



G, 



,28 



1 



,29 



,26 



W 



1 



,29 



,29 



W 







1 w 


w 



Part 3 In part 2 it was shown that l/w G S' and that there exists / G S" such that |-|^^ / 



The 



rest of this part is based on the fact that g £ imphes g G cj^"*. Since 7-3 > there exists a function 



ipeC^ such that < V < 1, ?A = 1 on B (0; rg) and t/- = outside B (0; 2r3). Hence 
and since / = ^ G 5' we have 



1 - ll) 



,29 



,29 



es'n L], 



loc 



(1.35) 



The next step is to prove that a;" (1 — V') / G when \a\ < [2kJ . But 

1 - 



X" {1-Tp)f = X"- 



,29 ' 



(1.36) 



and if |a| < [2kJ 



and 



1 - -0 



,29 



dx < 



,29 



\-\>r3 

by property W3.2. Hence a;" 
G C'^B^ when |a| < [2kJ i.e. 

Also, from equation 11.351 



M>'-3 
1 - -0 

I |2e 
w • 



1-0 



,29 



i2k 



|2k-|q| I |2e 



< 



1 



1 - V 



,29 



< 



|l"l 



(^3) 



2K-|a| 



M>'-3 



i2k 



1 26 



,29 ' 



< CX), 



G when |a| < [2kJ , and so 



1-0 



,29 



1 - -0 



,26 



G C 



(L2«^J) 



(1.37) 



1-0; 



,29 



or on rearranging 



/ = 



1 - -0 



,29 



We already know from 11.371 that the first term on the right is a Cg'^'^^^ function and since ip has 
bounded support 0/ is a distribution with compact support and by Appendix IA.6.21 the inverse Fourier 
transform is a Cfp function. Thus / G C^l^^^^ + Cfp 



(1.38) 



^(L2kJ) 
'BP 



Part 4 Follows directly from parts 2 and 3. ■ 

We summarize our basis function smoothness results in: 

Summary 51 Suppose a weight function w has properties W2 and W3 for order 6 and smoothness 
parameter k. Suppose G is a basis distribution of order 9 generated by w. Then: 

1. Ifw has property W3.1 then G G cj}^''^^ (Theorem\4^. 
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2. Ifw has property W3.2 then G e C^^skJ) ^^^^^ ^ Theorem\5^. 

Remark 52 Note that if a weight function has property W2 then basis distributions are defined for all 
positive orders. However, if the weight function also has property W3 we have only proved that the basis 
distribution is continuous if the order of the basis distribution matches the order of the weight 
function. 

Continuous basis distributions can be used to express the solution of the interpolation and smoothing 
problems discussed later. 



1.6.3 Summary diagram 



Figure fT. 6 .31 illustrates the relationships between the weight function properties and the basis distribution 
properties proved in the last section. 



If w satisfies 
W2 



If w also satisfies 
W3.1 
for 6, K. 



If w also satisfies 
W3.2 
for 6, K. 







1. 




Define basis 


distribution G E S' , 


any order 9 > 1, 






by 




G,0 


_ r 4, 










2.1 



(L2kJ) 



2.2 



GeC 



(L2kJ) 
BP ■ 



Box 1 A tempered basis distribution G of order 6* > 1 is defined for weight functions w which satisfy 
property W2. When 9 is positive this coincides with Light and Wayne's definition. 



Box 2.1 Suppose w also has the property W3.1 for order 9 >\ and smoothness parameter k. Then by 



Theorem |49] the basis distribution G of order 6* is a basis function in gI^^'^^ 



Box 2.2 Suppose w also has the property W3.2 for order 9 >1 and smoothness parameter k > 0. Then 

There are no 



by Theorem [SU] the basis distribution G of order is a basis function in C gp 
growth estimates near infinity. 



(L2kJ) 



1.6.4 The extended B-spUne basis functions 

Suppose w is an extended B-spline weight function 11.101 which has property W3.1 for order 9 and 
smoothness parameter n. Then by Theorem 1491 (^Jlij^'p^) ^ basis function of order 9. However the 

formula ^^^ypps'^ does not in general lend itself to the calculation of a 'closed form' suitable for numeric 
calculations involving basis functions e.g. basis function smoothers, so we will derive an alternative 
convolution form for the basis functions in Theorem [SHl In fact these basis functions turn out to 
be derivatives of the zero order extended B-spline basis function convolved with a thin- 
plate spHne basis function. To show this we will need three lemmas. The first lemma gives some 
properties of the zero order extended B-splines proved in Chapter 1 of Williams [22] . 
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Lemma 53 Suppose w is the extended B-spline weight function \1.10\ and suppose 1 < n < I. Then 
1/w £ and the basis function Gq = (-i) of order zero generated by w is the tensor product 

d 

Go (s) = n H (xk) where 
fe=i 

H (t) = (-1)'-" ^&D'<~'--^ ((*A)') (A) , t€R\ 

and (*A)' denotes the convolution of I 1- dimensional hat functions. 
Further, if n < I we have 

l — n 

i?^('-")(*A/ = (-l)'-"(*A)'-"* (-1)'"(W)^(--^)' 

k=-(l-n) 

is a bounded, piecewise constant function and D^"H is the sum of a finite 
number of translated delta functions. 

Finally Gq £ Cq^" "^^ (K'*), the- derivatives {-D"Go}|fj|^2n-i '^'^^ bounded functions with bounded sup- 
port, and the derivatives {-D"Go}|^|^2n '^'"^ tensor product of bounded functions with bounded support 
and finite sums of translated delta functions. 

Proof. The zero order weight and basis functions are defined above in Subsection 11.2.11 By Theorem 
7 of Wilhams ,22J w has the zero order property W2 f equation II. ip for k = n — 1. Thus 1/w G by 
property W2 and from [L2l the zero order basis function is Go = (:^) . This lemma now foUows from 
Theorem 29 of Wilhams [22 . ■ 

Lemma 54 Ifw is the extended B-spline weight function \ 1 . 1 0\ and 1 <n<l then ^ G C^2d(i~n)^^B'p- 

Proof. Go is a distribution and has bounded support so by Appendix lA. 6. 2i Go = — G Cb'p- Further, 
if 1 = (1, . . . , 1) G R'^ we write 

t ^ • 21 ^ -21 • 21 

1 (2.)f]j5!!L_^^(2,)f]J^f-»)!!!i_^ = (2.^ 



„2l 



^ ' 1=1 ' 1=1 * 1=1 ' 

=(2^)^x2('-")Mn""'" 



d . 2 

sm Xi 
u=i ^ 



(27r)^a;2('-")i ((271)^(22;))', 



where the last step used property [T3] of the tensor product hat function defined bv ll.3l and ll.4l But by 
11.31 A has bounded support so by Appendix IA.6.2| A G G^p. Theorem [TSl can now be applied to prove 
that G G0~2d(!-n) n ^BP and consequently that ^ G G^^ d(z_„) n Gg^p. ■ 

Lemma 55 Suppose Tm is the thin-plate spline basis function with integer order m > d/2 i.e. 



rr _ J (-1)'" ^'^ ''logia;!, d even, , . 



i. For some constant Cm > 



^™ = 7^ O"- '5'0,2m- (1-40) 



^. T„ G G^j^p "'^"^^ n G°° (M''\0). 

3. When d is odd, D^Tm is a bounded function when \a\ = 2m — d. 

4. When d is even, \D°'Tm {x)\ < fca (1 + |log |a;||) when \a\ — 2m — d. 
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Proof. Part 1 The thin-plate (surface) spUne basis functions T„i given by 11.391 are those of Dyn [1] 
equation 4 multiphed by the power of minus one which makes its Fourier transform i 1.401 a positive function 
outside the origin. The power of minus one can be determined by comparing the Fourier transform of 
the differential equation 7 of Dyn with equations 23 and 24. Alternatively, Subsection 1 2 . 3 . 1 1 of Chapter [2] 
gives the relevant formulas based on Dyn's paper e.g. Cm ~ e {m ~ d/2) where the function e is defined 
in equation 12.51 

The modified form of Dyn's equation 7 is 



\D\'"'T^^{-ir{2TTf^c^6, 

nstant > 0. Takir 
i-lY" {2TTf^ cj ^ {~ir i.e 



for some constant Cm > 0. Taking the Fourier transform of this equation yields (— 1)™ j-l^™ r„ 



|f"'T™ = c™, (1.41) 

and thus 

7;, = ^onR^0. (1.42) 

To prove we note that the constant function has weight function properties Wl, W2 and W3.2 
for order m and k iff m > K + d/2. Hence by Definition 1441 everv basis function G of order m generated by 
the weight function — satisfies G — on S'g 2m and so G = t^S^ on M.'\0 as distributions. Equation 

11.421 now implies supp (t^-G^ C {0} so that J\n-G is a finite sum of derivatives of delta functions 
and hence — G = p for some polynomial p. 



But by Theorem [m |f" G CS°^^ H C^p and (/) £ S implies |f G 50,2m- Hence 



,2m 

2m , I |2m / r 

which implies that p € P2m and therefore Tm — G G P2m • Theorem |^ now shows that Tm is a basis 
function of order m with weight function — and 11.40) follows. 



and If "G = Cm. Consequently = ICI^" {T\n - G) = 



Part 2 Clearly T™ G G°° (M'*\0). Now m > k + d/2 so that 2m > 2k + d and [2kJ = 2m - d - 1 and 
thus Tm G C'gp^'^^^^ by Theorem Ha 

Part 3 When d is odd, Tm (x) = (^_^^m-{d-i)/2 ^^^2m-d ^ ^j^^^ 

is a homogeneous function of 

order 2m - d and so D^T^ (Xx) = A^™"'^T>"Tm (x) = A'"' (D^Tm) (x) which implies T'^Tm (x) = 
|^|2m-d-|a| paj,^j ^j^g^ |^| ^ 2,n - d, D'^T^ (x) = (i?"Tm) (^) and i^"Tm is bounded. 

Part 4 When d is even, Tm (x) = (^_]^)™^('='~2)/2 |2;|^™^'*log |a;|. Hint: First observe that T)fclog|a;| is 
a homogeneous function of order —1 and that is a homogeneous function of order 2n. Then, on 

setting n — (2m — d) /2, expand (^|x|^" log using the Leibniz rule lA.ll ■ 

Theorem 56 Suppose w is an extended B-spline weight function ] 1 . 1 0\ which has property W3.1 Jar order 
9 and k. Then Gq = (:^)^ is the zero order extended B-spline basis function and Gg — (^ ^^^^20 
order 9 basis function. In fact, the basis function Gq has the form 



( ^Go*Te, 29 >d, 



Go = <^ 



L2^^Zl\Df+'~^'Go*T^, 29<d,dodd, ^^^^3^ 
^ ^ j.^^^ 29<d, d even, 

C d+2 ' ' —2~ — 



where Tm is the thin-plate spline basis function of integer order m > d/2 given in Lemma 1551 The 
convolutions of \1.4-3\ can be written 

(Go * Tm) (x) = (2^)-''/' / Go (y) Tm (x - y) dy, m > d/2, (1.44) 



with Go * Tm being a regular tempered distribution as defined in Avvendix \A.5.1\ 
Also, max [2kJ = 2n-2 + 2[9/d\ and Go G c'(j2n-2+2Le/dj)_ 
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Proof. Since w has property W3.1 for parameters 9 and k it follows from Lemma [5^ that ^ E and 
that G = (— )^ is the miique zero order basis function. Also, from Theorem 03] we have that 



is a basis function of order 9. Now suppose that e 5. By Lemma [54] ^ £ C$^2de ^ ^b'p^ ^'^^ so 



28- 



(1.45) 



Case 29 > d By Lemma [551 -^Te 



= -rjw on 5*0,26 , and thus 



1— ' 




" 1 1 , 












|.|2«'u.'^ 




.C2e 





1 

-Le 

C20 W 



1 

C2e 
1 

C29 



GoTe, (j) 
Go * Tg, 



so that = -^Go ^T^. 



Case 29 < d and d is odd 



By Lemma [551 Td+i = Cd+i — t^+tt on 5*0, d+i; and thus 11.451 implies 



Gfl 



1 



1 



C d + l 
L 2 



1 




29 


C d+1 
2 








d+l- 


-261 


Cd+l 

2 










-20 


Cd + l 







<d+l~2e 

<!> 

w 

I ^d+1-28 
W 



Td+l . 



Go Tdi 



d+l g 

tll^ (iDl'+'-^'Go^Td^ 

C d+l \ 2 



so that Gfl 



d + l 
(-1) — ' 

C d+l 



IDf^^-^" Go*Td+i. 



Case 29 < d and d even 



G, 



_ (-1)" 



Cd+2 



\D 



In a very similar manner to the previous case we can obtain 
d+2-2e ^ Td+2. The last three cases combine to prove [L43l 



Since Theorem [53l implies Go G Gq 



(2n-2) 



and Lemma [551 shows that T,„ G G 



(2m-(i-l) 



[m follows 



from the convolution formulas of part 5 of Appendix 12451 

Finally, if a weight function w has property W3.1 for order 9 and k then Theorem [49] implies Gg e 

/^(L2«J) 

^(2n-2+2L6(/dJ) 



^ . But from 11.171 the largest valid integer value of 2k is 2n — 2 -f 2 so it follows that Gg G 



i.^).5 Convolution formulas for basis functions generated by weight functions with 
property W3.1 

In this subsection we will develop convolution formulas designed to facilitate the expression of positive 
order basis functions in a closed form which can be used for numerical work. 
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Lemma 57 Suppose the weight function w has property W3.1 for 9 and k. Then there exists a multi- 
index a such that \a\ = 29 and: 

1. Wa (C) — £."w (i^) is a zero order weight function with property W2 for parameter k. 

unique zero order basis function generated by Wa ■ 

3. Go = (1/w) e S' and we call this the zero order distribution generated by w. 

4- Ge = ^ ^|"^|28 ^ G Cgp'^^'^ is a basis function of order 9 generated by w. 

Proof. The properties Wl and W2 of a zero order weight function are given in Subsection ll.2.11 Observe 
that the properties Wl for both the zero and positive order cases are identical. 

Part 1 Since w has property Wl it has property Wl as a zero order weight function and must be 
continuous and positive outside some closed set A with measure zero. Hence Wa is continuous and positive 

d 

outside the closed set U IJ {x : Xk = 0}. Since this set also has measure zero, Wa also has property 

k=l 

Wl i.e. it is a zero order weight function. 

By Theorem[3 f — — 7;—dx < oo when < t < k. Thus f ^^dx < oo when < t < k and so has 

property W2 for parameter k as a zero order weight function. 

Part 2 From Subsection II . 2 . 1 1 the zero order basis function is (l/wa)^ and it is a function in c'"g'^'^^\ 

Part 3 By part 1 of Theorem EDI 1/we S'. 

Part 4 By Theorem HSl Ge = (^^yjqw) e cj^p^^^ is a basis function of order 9 generated by w. ■ 
We begin with the case where Ga has bounded support, which simplifies the convolution. 

Theorem 58 Suppose the weight function w has property W3.1 for order 9 and k. Assume the weight 
function Wa, the basis functions Ga, Ge and the basis distribution Gq are as defined above in Lemma 
\57\ Then if Ga has bounded support the convolution formulas 



Ge 



L:£-D^"Ga*Te, 29 > d, 

d+l 

(-ir^ |^|d+l-29^2a(^^ ^ j.^^ 20 <d, dodd, 



-^j^\u\ u LxQ*jd±i, z{7 ^ a, a oaa, (1.46) 

-1)^ I nl'i+2-29 n2a 



Cd + 2 



^r^^^^^D^^Ga *Td+2, 29<d,deven, 



hold. Here T„i is the thin-plate spline basis function of integer order m > d/2 defined in Lemma [5E[ 
The convolutions of \1.4(>\ can be written 

(Ga * Trn) {x) = (2^)-'^/' / G„ (y) T„ {x - y) dy, m > d/2, (1.47) 



with Ga * Tjn being a regular tempered distribution ( Appendix \A.5.i\ ). 
Finally 

{-if D^^Ga = Go. (1.48) 
Proof. Since Ga has bounded support it follows from Appendix IA.6.21 and Lemma [571 that 

g; = — e C^p, (1.49) 

Wa 



and by Theorem 1151 



/-2a 



^ MO e ^0,20, c^(^S. (1.50) 



Case 29 > d Thus if ^ is the action variable 
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But Lemma [55] tells us that Tg E C 



(2e-!i-l) 
BP 



and Tg — on 5*0 29- Hence 



1 c 



2a 



:2e ■ 



Wo 



2a 



— Je, 

eg Wa 



1 e"- 

-—Tg 

eg Wa 



and, since Ga has bounded support, by part 4 of Appendix 12451 



fg 

eg 



eg 



(^1) /T^2ar- --^^ 



C0 



i?^"G„ * Tg 



so that = -t^i^ (i:'2"G„ * Te)'' and Gg = i^DS^Ga * Te 



Case 26 < d and d is odd 



If ^ is the distribution action variable then since ^ G G^p 



Gg, ( 



,26 



1 I |2(^-e) , 



1 <;2a| |2(^^±i-e) , 



By Theoremim G ^b,^., |f ('^-') € ^0,d+i-2«, f " e 50,,+i and <^ ^ 

5'0,d+i. Thus 



d+l- 



Also by Lemma [55| 



so that 



Gfl 



and hence 



Td+i = Cd+i „,a+i\ on d+i, 



1 e^|,2(^-.)^ 

|.|2(^)'u;JI 



1 


Td-\-i 




Cd+1 


2 




2 






1 










2 






1 






Cd+1 




2 






1 




\'+'-'' (g„ * 


Cd+1 







(-1) 

ed+ 



d+l V 2 



Ge = Lil^ 1^1^+1-26 ^2ag^ ^ 



(1.51) 

(1.52) 



C d+l 



Case 29 < d and d is even 



This case can be proved in a very similar manner to the previous case. 



The last three cases combine to prove 11.461 Equation 11.471 follows directly from part 5 of Appendix 



Since G„ = ^ S we have x^^G^ = ^ = Go, and hence (-1)'' D^^'Ga = Ga e S' n £' . ■ 

Remark 59 The reciprocal of an extended B-spline weight function is so the basis function Gq is 
continuous. Substituting \1.4'E\ i.e. Go = (— 1)^-D^"Gq, into \1.4'^ we obtain the equations \1.43\ for the 
extended B-spline basis functions. 



36 1. Extensions of Light's class of weight functions 



We now will prove a more general result which does not assume that Ga has bounded support. 
Instead we assume that Ga G and that 

/ Ga (y) Tm {x — y) dy defines a regular tempered distribution. To prove our theorem we will use the 
following result in which we use the function notation - a notational necessity - for the action of distri- 
butions: 

Lemma 60 (Theorem 2.7.5 Vladimirov J 21]) Suppose f,g V and g has hounded support (g G £'). 
Then the convolution f * g exists and 



[f * g, ^] = [/ (x) giy),rj (y) <t> {x + y)] , € CS° , 



(1.53) 



where rj is any test function equal to one in a neighborhood of suppg. 

Note: the distribution on the right side of \1.53\ is called a tensor or direct product and in the 

literature it is variously denoted f®g,fy^gorf-gin 'operator notation' and when 'function notation 
with action variables' is used we can write f (x) g (y) or f (x) ■ g (y), for example. The tensor product is 
defined for f,geV' (R'^) by 



[f ® g, 0] - [/ (x) , [g (y) , <t> (x, y)]] , G C^T (M'^ x W^) , 



(1.54) 



and has the properties you would expect e.g. commutivity, associativity, continuity. See for example 
Section 2. 7 Vladimirov fW. 



Theorem 61 Suppose the weight function w has property WS.l for order and k. Then there exists 
a multi-index a such that \a\ = 9 and \1.8\ is true. Let Ga be the basis function of order zero generated 
by the zero order weight function Wa (0 = i'^w (f) and assume Ga S . Suppose Tm is the thin-plate 
spline basis function of integer order m > d/2 given in Lemma\5^ 



We shall show that if Go is the basis function 
by the convolutions 



of order 9 generated by w, and Hg is defined 



Ho = < 



tzlfD-''-Ga*To, 

d+1 



(-1)" 



D 



d+l-2e p)2q 



D^°'Ga*Td+l, 



Cd+1 

c d+2 I I " 



9 > d/2, 

9 < d/2, d odd, 

9 < d/2, d even. 



(1.55) 



where 



{Ga * T„0 {x) ^ {2^)-'''^ / Ga (y) T,„ (x - y) dy, m > d/2. 



(1.56) 



then Gg — Hg as tempered distributions whenever the convolution integral defines a regular tempered 
distribution. 



Proof. In this proof we will refer to Lemma \57\ for the properties of the zero order weight and basis 
functions used in this theorem. Since Ga no longer has bounded support we will use a partition of unity 
{tp^, 1 - choose ^ € so that supp V' C B (0; 2), < -0 < 1 and i/' = 1 on B (0; 1). Now define 
tP^ (^) = ip (eO for e > 0. 



Case 29 >d 



Since ipe^a has bounded support, ip^Ga G C'bp ^'^'i ^ action variable 



Gg, i 



,261 



,20 



p2a 
I ,29 ' ^ 



i'e^a p2a 
, ,29 ^ 



{{\-i,,)Gar_ ^2a^ 
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But Lemma [55] tells us that Tg — -pjfg- on S'0_2ej and since iIj a^^"' <!> G 50,26 when 4> & S 



2a 



—Te,ip^Ga£, 
ce 



2a 



SO that 



C0 



eg 



g. = Li)!(z,-„,G„).r,)%£::<<'-*'.>°")" 



eg 



,2e 



(1.57) 



We now want to show that the second term on the right converges to zero as a tempered distribution. 
In fact 



2„((i-vgG^ 

I i2e 



/■2a 



((1-V>JG„/ 
I i2e 



< 



/■2a 



,26 



|((l^^,)G^/ 
I i2e 



i((i-^jG„riic 
< I / i((i-v^jG„ri)ii0iu, 



but since Ga e we have |((1-VJG„)^| < /|.|>i |G„| ^ as e ^ 0+. Thus as a tempered 
distributions 



(1.58) 



and so[I37|imphes that (D^" (TA^Ga) * Tg) ' converges to Gg in the sense of tempered distribution 



I.e. 



(-1) r^2a 



eg 



L>2" i^^Gc) ^Tg ^ Gg as e ^ 0+. 



(1.59) 



Since tp^Ga has bounded support we can use equation 11.531 of Lemma l60l to express the convolution 
in terms of the direct product. Thus 

(2^)^ [(^,G„) * Tg, = [{^^Gc.) {x) Tg (y) , 77, (x) (x + y)] . 
for any 77^ S G^ equal to one in a neighborhood of supp [ipfia]- Now 

[{i}}fia){x)Tg{y) ,ri^{x)(t){x + y)] = / [ ip^ (x) Ga {x)Tg (y) (j) {x + y) dydx 

V'e (2^' - y') Ga (x' - y') Tg {y') (f) {x') dy'dx 

i,^ {x' - y') G„ [x' ~ y') Tg {y') dy'cj, {x') dx' 

G„ {x' -y')Tg{y')dy'cP{x')dx' - 

(1 - {x' - y')) G„ {x' - y') Tg {y') dy' ct> {x') dx' . 



Since we have assumed that J Ga {x' — y') Tg {y') dy' defines a regular tempered distribution the first 
integral of the last equation exists and hence the second integral also exists and so converges to zero as 
£ ^ since the region of integration lies outside the ball B (^0; -^^^ ■ Thus {ip^Ga) * Tg converges to 

(27r)~^ / Ga {x' - y')Tg {y')dy' as £ ^ 0. But hyWM Hg = ^i^^a * T9 ^ Ge as £ ^ 0+ 

and we can conclude that 
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Ge = (27r 



Z?2"/G„ [x' ^y')Te{y')dy'. 



Case 29 < d and d is odd 



Gg 



,20 



w 



If ^ is the action variable 
1 



■\ \ 2 J yj 



1 



:d+l-2e 



/-2a I |d+l-26» 



Ga f.2a I |d+l-2e 



((l-Ve)GQ)'^ 2a I |<i+l-2e 



2a 



^((l-V'e)Gar,0 



SO that bv [T3T] and [T3^ 



^eGq ^2a I |d+l-2e ^ 



1 7'7^t2a I |d+l-2e 



Cd+l 2 



1 f2a I |d+l-2e 7^7^ T^^ ~ ^ 



Cd+l 
2 



^^2a|.|.+ l-2. U^G^,T^)\d, 



(-1) 



Cd+ 



— (D^'-\Df+'-^'{^^,G^)*Td^) ,0 



and 11.601 now becomes 



and thus 



(-1)" 



C d+l 



Gg = (d'" 1^1^+1-2. ^ + 7^ ((1 - ^e) Ga)' 



i?'" (^eGa) * Td±l ) > 



^2a 



(1.60) 



Comparing this equation with equation ll.57l of the previous case we see that the subsequent calculations 
are also valid here and we can conclude that 11.581 holds i.e. ^2a (^"^1)*^° converges to zero as a tempered 
distribution. Thus as tempered distributions 



-1)" 



^2a |^|d+i-2e (^^^Q^) ^Td+i^Gg as 0+. 



Cd + l 



Finally, the calculations of the previous part following 1 1.591 are valid for this case when 9 = {d + 1) /2 
and these complete the proof of this case. 



Case 29 < d and d is even 



This case can be proved in a very similar manner to the previous case. ■ 

Remark 62 The condition Ga G of the last result can be used to deduce information about Wa and 
w. In fact, Corollary 3.7 of Petersen It 61 implies that 

1 



(27r)"5 / e'^^Gc, (x) da; 



(1.61) 
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holds a.e. and that can be modified on a set of measure zero so that it is a continuous, bounded 
function which converges to zero at infinity and is such that \1.6l\ holds everywhere. Thus 

^ <(2^)"^||G„||i (1.62) 



and so lim^^^^^ Wa (x) = oo, Wa G C^*'^ (M'') and Wa is always positive which implies that Wa has 
property Wl for the set A ^ {}. 

Further, -^^^ = so that by \1.62\ w (f) > yg'^i^ ^ which implies w is always positive and can 

only have discontinuities on the axes ^j, = 0. Indeed, w is discontinuous on ^j. = iff Oik — Q- 

The last theorem required that the convolution integral of 11.561 be a regular tempered distribution 
and that Ga G ■ We complete this subsection by providing a single condition 11.631 for which those 
requirements are satisfied. 

Corollary 63 Suppose Ga and T,n are as given in Theorem \61\ and suppose Ga also satisfies the in- 
equality 

\Ga{v)\<c{l + \y\r , (1-63) 
for some s > 2m and constant c. Then Ga G and 

(2^)-'*/' / Ga {y) Tra {x - y) dy, m > d/2, (1.64) 



is absolutely convergent for all x and defines a continuous function of polynomial increase. It is also a 
regular tempered distribution (as defined in A vvendix \A.5.1\) . 

Proof. Since Ga satisfies inequalitv II .631 and m > d/2 it follows that s> d and so Ga G L^. Further 



Ga [y) Tm [x - y) dy 



Ga {x - y) Tm [y] dy 



< / \Ga{x - y)Tm{y)\dy 



<a[ dy 

-V ii+\x-y\r''y 

= c(l + |a;|) / , I ,.s dy 



(i + |yir 

c{l + \x\r I ^^^^dy + c{l + \x\r [ T^^dy. (1.65) 

'iai<i (1 + I2/I) J\y\>i [^ + \y\) 



Since Tm is continuous the first integral of the last term exists. From[TT33 
Tm {y) = 



( -I \7n—(d—2) /2 I \2m—di \ \ i 

(-1) \y\ log\y\, deven. 



Thus if d is odd then 



/-I , I i^s dy < / . I ..s dy < / \y\' dy, 

iyi>i(i + |y|) J (i + |y|) J 

\v\>i \v\>i 
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which exists since s > 2m. If d is even and s ~ 2m + le then 

(\-r\v\r\Tra{y)\dv< f (l + |2;|)-^|2;|"log|y|dy< / \y f \og\y\ dy 



|y|>i \v\>i \y\>i 



= j \y\ '^^\og\y\dy 
|y|>i 

[ 1 \og\y\ 

~ J \yf^^ \yr ^ 

\y\>i 

^ logr r 1 

"r>? J \yf+' 

\v\>i ' ' 

< oo. 



We now know that if s > 2m then for a constant c' independent of x 

\G^iy)Tmix-y)\dy<c'{l + \x\Y, x € (1.66) 



and so 11.641 is absolutely convergent and with polynomial growth at infinity. 

To prove that / Gq (y) Tm {x — y) dy is a continuous function of x we use the Lebesgue-dominated 
convergence theorem. First note that / Ga (y) Tm (x — y)dy = J Ga (x — y) Tm ijj) dy and that in the 
proof of 11.661 it was shown that 

\Go.{x-y)Tm{y)\<c{l + \x\r l^™^^^' 



(i + |yir 

a+\v\r 



and that j'^T\ ^i\s £ ■ Thus if Xk x is any sequence in the ball B (x; 1) then 



|G„ {xk - y) Tm {y)\ <c{l + \xk~x\ + \x\r P^t% < ^ (2 + {x^ 



ii + \y\r - ' ' ' " (i + Mr' 

and by the Lebesgue-dominated convergence theorem 

lim / Ga {y) Tm {xk -y)dy = lim / Ga {xk - y) Tm {y) dy ^ Ga{x- y) Tm (y) dy, 

Xk^X J Xk^X J J 

and so proving continuity. A function / £ Lj^^ for which J \f {x) \ {1 + Ix])"^ dx exists for some A > 
is called a regular tempered distribution. Clearly a continuous function of polynomial growth at infinity 
is a regular tempered distribution. ■ 

1.6.6 Positive definite and conditionally positive definite basis distributions 

In his work, Duchon did not mention the concept of conditional positive definite basis functions, but 
used as his starting point a weight function. Subsequent to Duchon's work various other classes of 
functions were used as basis functions in numerical work and these were studied from the point of view 
of (conditional) positive definiteness. This second major strand to the development of the theory of 
basis function interpolation has involved the use of the theory surrounding conditionally positive definite 
functions to develop the correct setting for a variational approach. Work on this approach includes papers 
by Schoenberg [TS], Micchelli TSj, Madych and Nelson [T^, [T3], Wu and Schaback [25 and in a series 
of papers by Schaback which the reader can find in the survey [18| . 

In their work Light and Wayne [TTj returned to the approach of Duchon and the concept of (conditional) 
positive definiteness again plays a peripheral role. In the work of these authors it is only after their basis 
distributions have been defined, and their properties elucidated, that it is shown that they are positive 
definite or conditionally positive definite. They showed in Theorem 4.3 of [11] that the (integer) order of 
the basis distribution is the same as the order of the conditional positive definiteness. 

Following Chapter 4 of Light and Wayne JTj, the objective of this section is to show that the basis 
distributions G of order 6 are conditionally positive definite distributions of order 9. The definition of a 
conditionally positive definite tempered distribution involves the concept of a homogeneous polynomial 
over the complex numbers C. 
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Definition 64 Homogeneous polynomial over C 

A homogeneous polynomial p, of degree 9 over C, has the form 



\0\=e 



Following Gelfand and Vilenkin [S] and Light and Wayne [TT] we define a conditionally strictly positive 
definite tempered distribution as follows: 

Definition 65 Conditionally strictly positive definite tempered distributions 

A distribution F £ S' is said to be conditionally strictly positive definite of order 9 > \ if the inequality 



ppF, iptp 



> 0, holds for all ^ S , tjj ^ and all homogeneous polynomials p ^ 0, of order i 



Theorem 66 Assume w is a weight function with property W2. Now suppose G G 5" is a basis distri- 
bution of order 9 generated by the weight function w. 

Then we show that G is a conditionally positive definite tempered distribution of order 9. 

Proof. Suppose p — ^ Ojsx^ is a homogeneous polynomial of order 9 and t/i e S", ■0 7^ 0. 

\f)\<e 



Then 



ppG^ iptp 



G,ppiptp 



and 



ppipip = I ^ a^x" ^ apx 
y\a\=e J \W\=e 



\a\=e\i3\=e 



Now la + /3| = 29 implies x^^^Tpip G 'S'0,2e and so ppipip S ■S'e 



26- 



But G has order 9 so, 



G, I 



J 1*^28 for all (f) g 50_2e- Thus for all iIj S, ppipijj e S'0,2e and 



ppG, iptp 



Gjppipijj 



[ppip^l)) 



,20 



I |26l ■ 



Clearly / 



I i2e 



implies that pip = a.e. Does this imply p = or -0 = 0? Certainly, in one 



dimension p will have a finite number of zeros, and so ip — 0. But what about in higher dimensions? 

This result will be proved by induction on the number of dimensions. Suppose the result is true for 
d dimensions, and that p^ = in d + 1 dimensions for some p ^ 0. Thus p (x' ,Xii) ip {x' ,Xd) = for 
all X = (a;', Xd)- For fixed Xd, p (a;', Xd) is a polynomial in — 1 dimensions and ip {x' , Xd) G S in d ~ 1 
dimensions. Thus, for each Xd, tp {x' , Xd) — for all x' and so t/; = 0. ■ 



1.7 Weight property generalizations 

In this section we finish the document by briefly presenting two generalizations which include both 
properties W3.1 and W3.2. 



Theorem 67 Suppose 9 > 1 is an integer, k > and rg > 0. Suppose fj, : 
a.e. on \x\ > rg. Then if 



and < fi (x) < \x\ 



26 



l2t 



w (x) /i (x) 



dx < oo, < t < K, 



(1.67) 



we have: 

1. w has property W3.2 for 9, k and r^, where r^ = ?'3 if f's > and rg > z/ rg = 0. 

2. //rg = then 1/w G Lj^^ i.e. w has property W2.1. 

3. If fi (x) = x" , \a\ — 9 and r'^ — we have property W3.1. 

4. If IJ, {x) = \x\^^ and rg > we have property W3.2 for rg — r'^. 



42 



1. Extensions of Light's class of weight functions 



Proof. Part 1 The application of the inequality: < fi{x) < \x\ a.e. on \x\ > r^, to 11.671 implies the 
inequalities of part 1 of Theorem [7] and so w has property W3.2. 

Part 2 If X is compact then K C B (0; r) for some r > 0,and so 



by [T^ with rJj = and < = 0. 

Parts 3 and 4 follow from part 1 of Theorem [71 ■ 

Thus the smoothness results for X^^ and the basis distributions implied by property W3.2 also apply 
to property 11.671 

Now suppose > 4> > 1 are integers, k> and rg > 0. We say w has weight function property WG if 
there exists a multi- index a such that \a\ = — (j) and 



Clearly property WG generalizes properties W3.1 and W3.2 but the integral retains an interesting 
hybrid structure, part radial, part tensor product. With reference to the previous theorem, if we set 



fi (x) — \x\'^'^ x^" then /i (x) > a.e. when |a;| > r!, and /j, (x) — \xf'^ x^" = \xf'^ < \xf'^ |a;|^'"' = 
\x\^^ . Thus w (x) = \x\'^'^ x'^" has property 11.671 





da: < c», < i < K, 



2 



Proving a function is a basis function without using 



2.1 Introduction 

In this chapter we wiU prove some more properties of the basis functions studied in Chapter [T] where 
these objects were defined in terms of a weight function w and a positive integer order parameter 9. In 
Chapter [T] these weight function properties were used to define reproducing kernel semi-Hilbert spaces of 
continuous functions X'^ and continuous basis functions of order 9. In the Chapters HI [U [D these semi- 
Hilbert spaces will be used to formulate and study several non-parametric, basis function interpolation 
and smoothing problems with the basis functions being used to represent the solutions to these problems. 

In this chapter we are only concerned with the basis functions and we prove a result which will enable us 
to determine whether a given function is a basis function without recourse to the basis function definition 
11.331 used by Light and Wayne in llj. In practice their definition is difficult to use and involves a weight 
function and the bounded linear functionals on the subspace 5^ 29 — {<!> S : D°'4> (0) = 0, \a\ < 29} of 
the test functions of the tempered distributions S (Appendix IA.5|) . We give a simple test which can be 
applied to the tempered distribution Fourier transform of a continuous function. 

These results are then applied to several classes of well-known radial basis functions, the choice here 
following Dyn [3]: the thin-plate splines, the shifted thin-plate splines, the multiquadric and inverse 
niultiquadric functions and the Gaussian. These classes of basis functions are well known in the literature 
and details are given in Figure lT^ below. In the last section I will illustrate the method using a non-radial 
example: the fundamental solutions of homogeneous elliptic differential operators of even order. 



In this document we will prove that some of the important classes of functions used to define basis 
function intcrpolants and smoothers are basis functions in the Light sense i.e. generated by weight 
functions, without recourse to the awkward Definition [33] which uses the spaces >S'0_26» and 5*0 ^e- 

Our choice of basis functions is given in Tabic below and follows Dyn [3]. These basis functions are 
well known in the literature. Theorem 1691 is our main result and it will be applied to the various classes 
of radial and non-radial basis functions. 

We will need the following basis distribution and weight function properties which were proved in the 
previous chapter: 

Summary 68 

1. If a weight function w has property W2 then by part 2 of Avvendix \A.5~l[ W2.1 and W2.2 imply 
that Ijw is a regular tempered distribution and thus 1 /w G Lj^^ C] S' . 




2.2 Theory 



Now suppose the weight function w has properties W2.1 and W3.2 for order 9 and k. Then: 
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2. w has property W2 (part 3 Theorem ] 

3. If G is a basis distribution of order 9 then |-|^^G = — as tempered distributions (part 2 Theorem 
4- G E c|jp'^^\ where [-J is the floor function (part 4 Theorem \50\) . 

The next theorem is the main result and will allow us to determine when a C^p function is a basis 
function in the Light sense by only studying its Fourier transform and so avoid the need to use the 
awkward Definition 1441 of a basis function which uses Si^ 2n subspaces. 

Theorem 69 Suppose iJ e S" and \-\^^ H £ Ljoc- H&f^ce for some B C {0} we can define the function 
Hp e i^) by Hf=H on R'^\B. 

Suppose further that for some closed set A of measure zero containing B we have Hp G C^"-* (K'^y^) 
and Hp {C) > on R'^y^. Now define the function w by 

^iO^^fT- ' i£M.\A. (2.1) 

Then: 

1. w satisfies weight function property Wl w.r.t. the set A. 

2. Suppose w also has weight function properties W2.1 and W3.2 for some order 9 and k. Then 
H e cjjL^'^J) and H is a basis function of order 9 generated by w. 

Proof. Part 1 Clearly ^ is a closed set of measure zero and the properties of H imply that w £ 
C^"^ (E''\yl) and w {^) > on R'^\A. Hence w has property Wl with w.r.t. the set A. 

Part 2. Since w has properties W2.1 and W3.2, part 2 of Summary [68l implies that w has property 
W2. Part 1 of Summary then implies that 1/w e L]^^ n S' . 

By definition oi H p , \-\^^ H = \-\^^ H p as distributions on W^\A. ByO \-\^^ Hp ^ l/w a.e. so that 
\-\^^ Hp S L]^^ and since we have assumed that \-\^^ H G L]^^ it follows that \-\^^ Hp = \-^^ H = 1/w 
as distributions. But \-\^^ H G 5" and 1/w G S' so \-^^ H = 1/w as tempered distributions. If G is a 
basis distribution of order 9 generated by w then by part 3 of Summary 1681 I' I G = 1/w and the basis 
(tempered) distribution definition implies G = Hp on M'^\0 as distributions. From the definition of Hp, 
H = Hp on M''\0, and so supp ^G — H^ C {0}, which implies G — H = p where p is some polynomial. 

Howeyer, we haye proved that |-|'^''G = 1/w and = 1/w so, — (^G — H^ ~ \-f^P i-e. 

\D\^^ p — 0. But \D\^^ annihilates all members of P2e and no member of P\P2e so we must have p G P20- 
Thus H G G + P20 and Definition [44l means that is a basis distribution. Finally, by part 4 of Summary 



2.3 Examples: radial basis functions generated by weight functions in 
W3.2 

Table [5^ below gives a list of the radial functions derived from Dyn [?] and which are used as examples. 
Both types of splines have been generalized in the sense that the parameter s has been allowed to take 
non-integer values. Section 1 of Dyn 4 describes splines for which s has integer values. However, latter 
in Section 2 after Theorem 4, more general basis functions are introduced in equations 23 to 26. These 
are listed in Table 4.1, with a significant change. The change is to multiply by (— l)^'*^ or (— 1)'^'''^ so 
that the Fourier transform is positive. 
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Type 


Radial basis function 


Surface /thin- 






plcite spline 


i-iy^'r^-' logr, 


s = 1, 2, 3 


(generalized s) 






Shifted surface 


\ / \ / ^ 


a > 0, s > -d/2, 


/thin-plate 


1,2,3.... 


spline 


'^'^l"^' (a^ + r^Y log (a^ + r^) 


a > 0, 


(generalized s) 


s = 1,2,3,.... 


Multiquadric 


-(a2 + r2)^/^ 


a > 0, d > 1. 


Inverse multi- 


(a2+^2)-l/2^ 


a > 0. 


quadric 






Gaussian 


exp(-T) ■ 



(2.2) 



List of radial basis functions from Dyn [4]. 
2.3.1 Thin-plate spline or surface spline functions 

For arbitrary dimension d the continuous thin-plate spline (or surface spline) function H can be defined 

by 



H{x) 



(-1)^+^x1'^ log 5 = 1,2,3,..., 

(-l)M 



s > 0, s 7^ 1,2,3. 



(2.3) 



Because _ff is a regular tempered distribution, H E S' . In fact, from equations 23 and 24 of Dyn [3] 
we have that, as distributions. 



H^eis)\ 



,-2s-d 



on R'^\0, 



where e G C'^p. Specifically 

eis)- 

where c and c' are defined by 



(-1)^+V'(2s), 5 = 1,2,3,..., 
(-l)r^^c(2s), s>0, s^l,2,3..., 



dc 



c(t)^.^/^2-r(^ /r -i,, c _^^. 



(2.4) 



(2.5) 



(2.6) 



The next theorem will require that (^) > when ^ so the following lemma will be required. 
Lemma 70 e (s) > when s > 0. 

Proof. The proof is an application of the reflection formula 

1 X sin TTx 
FT V = ^ ^) ■ 

i ( — X) TT 

First suppose that s > and s 7^ 1, 2, 3 . . .. Then from 12.5 1 and 12.61 

e(s) = (-1)^^^ c(2s) = (-1)^^^ ^d/2^2s+d^ (-' + ^^^^'^ 

= ^rf/222.+rfr + r (s) 

= ,^/222.+.r + r (.) ,Ll)!!!!!£i!iI£ 
> 0. 
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Next assume s = 1,2,3,.... Then 

e(.) = (-ir^c'(2.)=(-ir+ii^c(2.) 



2 ds 

\s+l 



Li} ^d/222s+dp ( , + " ) r (S) S (- COS^S) 



(—1)"^"'^ d ( j/n / d\ „ , , \ — sinTTS 

+ 7r'*/222^+'^r s + - r (s) s ' 

2 ds \ \ 2 J 



>o, 



as required. 



Theorem 71 Let H be the generalized thin-plate function defined by equation \2.3[ With reference to 
Theorem 16'ffl equation \ 2.4\ implies Hp{£^) — e(s)|^| '^^ £ L\^^{U.'^\B) where B = {0}. For integer 
order 9 > 1 let A = {0} and define the function w bii \2.1\ i.e. 



wiO = ^g^ -^ICr''+''^^ C^O. (2.7) 



Then: 

1. w has weight function property Wl for the set A. 

2. w also has weight function properties W2.1 and W3.2 for 9 and k> iff < k < s < 9. 

3. IfO<K<s<9 then H is a basis function of order 9 generated by w. 

4. If t > 2s there exists a constant ct such that \H {x)\ < Q (1 + l^lY for all x. 

Proof. This theorem is an apphcation of Theorem . From [^T^ H (f ) = e (s) |^p2s-d ^j^^ condition 
if^He L\^^ is satisfied iff 29 - 2s - d > -d i.e. 

s<9. (2.8) 

Lemma [70] impUes Hp e C(°) {W'\A) and Hp (0 > on W'\A so that if we define the function w by 
12.71 part 1 of Theorem impUes w has Property Wl w.r.t. the set A. 
Property W2.1 requires that 1/w ^ L\oc- 

^ e(s)|^|"-^ (2.9) 



so that 1/w e L]^^ \E 29 — 2s — d > —d i.e. iff s < 6*, which is already implied by 



i2k 



Property W3.2 is true for order 9 and n if there exists ra > such that / 20 < But from 

|.|>r3 w\-\ 

I |2k 

/ 2e = ^7iy / I |23-2^+d and this exists iff 2s — 2k + d > d i.e. iff 

|.|>r3 w\-\ ^^"^-IJ^rs '■' 

K < s. (2.10) 

Thus w has properties Wl, W2.1 and W3.2 for some 9 and n if and only \i 9 > s and Q < n < s < 9. 
Now by part 2 of Theorem 1691 H is a basis function of order 9 generated by w. 
From [13] 

f \ f'}osM 5 = 1,2,3,..., 

{1 + \x\)-* H (x) = I ^ \, 
so that t > 2s implies (1 + |a;|)~ H {x) ^ as \x\ 00. Thus (1 + |x|)~ \H {x)\ is bounded. ■ 
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2.3.2 Shifted thin-plate spline or shifted surface spline functions 

For arbitrary dimension d the shifted thin-plate sphne functions H are defined for a > by 



(-1)= 



\xfy\og(a^ + \x\'), 5 = 1,2,3,, 



Hix) = { ' '{s " ^ ■ ■ ^ (2.11) 

(-1)^^^ (a2 + |x|') , s>-d/2, 5^1,2,3.... 

Now H £ S' and from equations 25, 26 and 27 of Dyn fl], as distributions, 

H iO - e{s) i^,+rf/2 {a lei) ler''^"' on R^O, s > -d/2, (2.12) 



where 

e(.) 

with 



{-iy+'c'{2.s), s = 1,2,3,..., 
(-1)^"^ c(2s) , s > -d/2, s ^ 1, 2, 3 . 



cit)^i2nf'2'^/Ti-t/2), ?^it) = ^, t>0, 



and 



Kx (<) = i^i^A (t) , i, A rea^, 
where Kx is the modified Bessel function of the second kind of order A. K\ has the foUowing properties 
Kx £ C(°) (R) ; Kx {t) > 0, t > 0; hm Kx {t) = exponentially. (2.13) 

t — *oo 

See for example Abramowitz and Stegun [1 . The next theorem will require that _ff (^) > when ^ 7^ 0, 
so we will need the following lemma. 

Lemma 72 e(s) > 0, £, £ R'^, s > -d/2. 

Proof. The proof is very similar to the proof that e (s) > when s > (Lemma [70| . It is again an 
application of the reflection formula [2. 221 

First suppose that s > —d/2 and s ^ 1,2,3... Then 

e{s) = (-1)^^^ c (2s) = (-1)^^^ {2T:f^ 2^+Vr {-s) = (-1)^''^ {2T:f^ r+^T (s) sZ£!!iIf 

TT 

= (^2nt"r+'T{s).st}^^^!l^ 

TT 

> 0. 

Next assume s = 1, 2, 3, . . . Then 

e{s)^(-ir'c'{2s) = {-ir'\^^c{2s) 

(-1)"+^ d f _d/2n2s+dT^ f ^ , d\^.,-simTS 



ds 



1) .V/0„0„^.7„ / d 



2 V 2. 



>o, 



as required. 



Theorem 73 Let H be the generalized shifted thin-plate function defined by equation With refer- 
ence to Theorem[Wi equation \ 2. 12\ together with \2.1^ imply Hp — e(s) 7^5+^/2 (a |$|) I^P^^^^''^'^ £ 
^]oc (K'^N'S) where B = {0}. For integer order 9 > 1 let A = {0} and define the function w by \2.1\ i.e. 

= = _i |^p2e+2s+d s>-d/2. (2.14) 

\e.fHp{0 e(.)X,+,/2(a|C|)' ' 

Then: 
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2. Proving a function is a basis function without using the spaces 50^2 



1. w has weight function property Wl w.r.t. the set A. 

2. w also has weight function properties W2.1 and W3.2 for and all k > iff —d/2 < s < 6. 

3. If -'d/2 < s < 6 then H is a basis function of order 9 generated by w. 

4- If t > 2s there exists a constant ct such that \H {x)\ < Ct {1 + \x\Y for all x. 

Proof. This theorem is an apphcation of Theorem From [2321 

H (0 = e (s) K,+a/2 (a ICI) ICP^""'' , C 7^ 0, s > -d/2, so the condition H e L^^ is satisfied iff 
26* - 2s - d > -d and s > -d/2 i.e. 

- d/2 < s <d. (2.15) 

Lemma[22]and[2ll3]imply Hp e C^") {W^XA) and Hp {£,) > on W^XA so that if we define the function 
w by 12. 141 part 1 of Theorem [551 imphes w has Property Wl w.r.t. the set A. 

Property W2.1 requires that 1/w E L]oc- But 

^ - e{s) {a lel) \^f-^'-'' , s > -d/2 (2.16) 



'(0) (R 

26 — 2s — d > —d i.e. s < 9, which is again constraint 12.151 



andlUlimpfies Kx e C^°'> (R) and Kx (t) > for t > 0, so that 1/w € iff 1^1^*^ G iff 



If" 

Property W3.2 is true for order 9 and k if there exists ^3 > such that J^.^y^s |2e ^ 



?nM when > 



|.|>r3 w\-\ J\i\>r3 



^^e{s) I K,+,/2{am)\^\'''-''-'dt 



and since bv 12.131 (a ICI) is continuous and hm e{s) Ks^(i/2{a\^\) exponentially, this 

integral always exists. Thus w has properties Wl, W2.1 and W3.2 for some 9 and any k > if and only 
12.151 is satisfied. Now by part 2 of Theorem \69\ H is a basis function of order 9 generated by w. 
FromlMH 

so that t > 2s implies (1 + \x\)~* H (x) — + as —* 00. Thus (1 + |a;|) * |i? (a;)| is bounded. ■ 
2. 3. 3 Multiquadric and inverse multiquadric basis functions 

In arbitrary dimension the multiquadric function is defined by: 

1/2 



H 



(0 = («' + iei') , a>0. 



In dimension d> 2 the inverse multiquadric function is defined by: 

— 1/2 



Note that these are clearly specific cases of the shifted surface splines discussed in the previous sub- 
section. These functions were introduced by Hardy [7] for geophysical applications. See also the review 
paper by Hardy ^Sj. 

2.3.4 The Gaussian 
The Gaussian function is 

iJ(x) =exp(-|a;|^) , xeW^. (2.17) 



and has Fourier transform 

iJ(0 = ^exp(-|^|V4), CeK'. (2.18) 
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Theorem 74 Let H be the Gaussian function defined by equation \2.17\ With reference to Theorem \69l 
eauation \2. 18\ implies 

Hf{0 = H{0(^LI,{R''), (2.19) 
so B = {}. For integer order 9 > 1 let A — {0} and define the function w bv \2.1\ i.e. 

- (0 - = ^ l^r" exp (lei^ /4) , e ^ A. (2.20) 

Then: 

1. w has weight function property Wl w.r.t. the set A. 

2. w also has weight function properties W2.1 and W3.2 for all 6 and k > 0. 

3. H is a basis function of order 9 generated by w. 

4. For any real t there exists a constant ct such that \H (x)| < Ct (1 + |x|)* for all x. 

Proof. This theorem is an appUcation of Theorem EHl From the condition \-\^^ H G Lj^^ is always 
satisfied. Equations EH] and EH] imply Hp € C(°) (R'^\^) and Hp (C) > on M.'^XA so that if we define 
the function w bv l2.71 part 1 of Theorem [69l means that w has Property Wl w.r.t. the set A = {0}. 

Property W2.1 requires that 1/w £ Lj^^. But 



so this is clearly true. 



-^|Crexp(-|C|V4), (2.21) 



Property W3.2 is true for given order and k if there exists ^3 > such that J ^ < 00, but 

this is obviously true from 12.211 

Thus w has properties Wl, W2.1 and W3.2 for any order 9 and k and by part 2 of Theorem |69l H is 
a basis function of order 6 generated by w. 

Finally, it is clear that (1 + |a;|)~* \H (x)| is bounded for any real t.. ■ 



2.4 Examples: non-radial basis functions generated by weight functions 
in W3.2 

2.4-1 Fundamental solutions of homogeneous elliptic differential operators of even 
order 

In Section 2 of Dyn [T describes a large class of non-radial functions on M'^ which are positive definite, 
namely the fundamental solutions of homogeneous elliptic differential operators of even order 29, where 
29 > d. In the next result we will use the weight function theory to prove that these fundamental solutions 
are scalar multiples of basis functions of order 9 generated by a weight function. 

Theorem 75 Suppose p is a homogeneous polynomial of degree 29 on R'^ , where 9 > 1 and 29 > d. 
Further, suppose that p (x) > if x ^ 0, and that f E S' is a fundamental solution of the differential 
operator p [D) . Then: 

1. The function w defined by 

w{x)^p(^-^^, x^O, (2.22) 

has property Wl of a weight function w.r.t. the set A — {0}. It also has properties W2.1 and W3.2 
for order 9 and k iff < 2k < 29 — d. 

2. H = (—1)^ (271)^^^^ / satisfies |-|^^ ^ w ^ ^Aoc distributions. 

3. H £ Cgp is a basis function of order 9 generated by the weight function w. 
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2. Proving a function is a basis function without using the spaces 50^2 



Proof. Part 1 Since the sphere | si = 1 is a compact set 

ci — mill {p (x) : \x\ = 1} , C2 — max {p (x) : \x\ — 1} , 
both exist. Also, ci, C2 > since p (a;) > if a; 7^ 0. We conclude that 

< Ci < W (x) < C2, X ^ 0, 

and clearly 

w e (R''\0) ; < — < < — , Xy^O, (2.23) 

^ ' C2 W[X) Ci 

and 

^^0- (2-24) 

P \X) W [X) \x\ 

Thus w has property Wl of a weight function for the set A — {0}, as well as property W2.1. Property 

W3.2 holds for order and k iff there exists ^3 > such that /|.|>^ ^ °° which bv l2.23l is true iff 

w\-\ 

20-2k> d. Thus w satisfies properties Wl, W2.1 and W3.2 for order 6* and k iff < 2k < 26* - d. 

Part 2 A tempered distribution / which satisfies the equation p (D) f ~ S is said to be a fundamental 
solution of the differential operator p {D). Taking the Fourier transform and noting that p is homogeneous 
of degree 29, p{D) f = p{-i£)J ^ {-if pf ^5 ^ {2^)"^^^ , so that (-1)%/ = (27r)^''/^ i.e. pH = \ as 
tempered distributions. 

But [123] implies ^ e and since ^ = ^ Nfl ^ lY^'^ H a.e. it follows that ^ = M^^if as 

distributions. 



Part 3 Here we will make use of Theorem [H^ Now H £ S' and by part 2, \-\^^ H — G Lj^ 



^ (oc as 

tempered distributions so for B = {0} we can define Hp E L\^^ [B) by Hp = H on M.'^\B. From the proof 
of part 2, pH = 1 as tempered distributions. Thus if we set ^ = S it follows that Hp ~ 1/p on R'^\^ 
and Hp e C(°) {R'^\A) and Hp {£,) > on R'^XA. Equation imphcs the weight function w of part 
1 coincides with that of 12.11 in Theorem Ell and so the results of part 1 allow us to use Theorem EH to 
conclude that H e cj^^^^J) and H is a basis function of order 9 generated by w. But < 2k < 29 — d 



implies [2kJ <29-d-lsoH€ C\^p 



(20-d-i) 




3.1 Introduction 



This chapter is based on the theory developed in Chapter[T] which extended the work of Light and Wayne 
[TT] The results given here are also closely related to the work of Madych and Nelson [13^ as is indicated 
in the remarks to several of our theorems. However, Madych and Nelson deal with the reciprocal of our 

weight function so that their space is formally X^^^^ = |u e 5' : / w^l^" < oo| so that in order to 

calculate their data space they need to construct a mapping from to X'^ Section 3. In a future 

document I will discuss the space ^jy^ and construct isometric isomorphisms from X^ to X^^_^ which 

show that X~^^ is isomorphic to the space of bounded hnear functionals on Xf^ i.e. (^^)' = X^^.f^j- 

In Chapter [T] smoothness and growth properties were derived for basis functions and smoothness, 
growth and completeness properties were exhibited for the data spaces Xf^. It was shown that every 
weight function generates a C^^SkJ) ]-,a,sis function where [-J denotes the floor function. However, the rate 
of growth of basis functions near infinity was only determined for a subclass of the weight functions. 
This subclass generates bounded basis functions with bounded derivatives. As for the functions in X^, 
it was shown that Xf^, C C^p^"* for all weight functions but no bounds on growth rates near infinity were 



The goal of this chapter is to derive 'modified' inverse-Fourier transform formulas for basis functions 
and the data functions X^ and to use these formulas to obtain bounds for the rates of increase of 
these functions and their derivatives near infinity. This will be done by proving a general inverse-Fourier 
transform formula for a subspace of the distributions and then applying it to both the basis functions 
and the data functions. From these formulas we will be able to show that all basis functions are either 
bounded or have a rate of increase of at most | • | ^"^^^ near infinity and that all data functions have a rate 
of increase of at most | ■ | '^''^ near infinity. 

We will also show that: 

1. There always exists a conjugate-even (complex- valued) basis function. 

2. If the weight function is even then there exists an even, real valued basis function. 

3. If the weight function is radial then there exists a radial basis function. 

The key operators used in this document are the projections 7^0^„ and Q0^„ which are given by 



where p G S", p(0) = 1, D^p{Q) = for 1 < < n. Here S is the space of C°° test functions for the 
tempered distributions - see Appendix IA.5I Thus they are based on the Taylor series expansion about 
the origin. 



obtained. 




|a| <n 
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3. More basis function and semi-Hilbert data space theory 



Section by section in brief: 

In Section 13.21 the null spaces and ranges of „ and Q^.n are derived. 

In Section 13.31 the distribution adjoints of „ and ^ are calculated. These are projections and 
we calculate their null spaces and ranges. 

In Section 13.41 we prove some upper bounds for the function j-DJQe.rt.^ (e'*^^'^^) |. 

In Section 13.51 an inverse Fourier transform result is derived for a class of distributions which will be 
applied in the next two sections. 

In Section 13.61 we prove an inverse Fourier transform formula for the basis functions. This is formula 
is used to derive the rates of increase of the basis functions near infinity and to derive the properties of 
a basis function given various properties of the weight function. 

In Section 13.71 an inverse Fourier transform theorem is proved for functions in Xf^ and then used to 
estimate their rates of increase near infinity. 



3.2 The operators V{j)^n and Q0 „ = I — Vij)^n 

The space Si^n is required to define the operators Vii^n and Qg^n which are central to this document: 
Definition 76 The spaces S'l „ 



^1. 



S, n = 0, 

{(j)eS:(l3 {0)^1: 01^(1) {0)^0, I < \f3\ < n} , n= 1,2,3,... 



Definition 77 The space pPn and the operators T-'g n, Q0,n- 
Suppose p G Si_n- Then for integer n > we define: 

1. The space pPn = {pp : p E Pn }- 

2. The mappings Vti^n ■ C'") C'") and Q0,„ = / - T'fl,,, : C^") ^ C^") are given by 



\a\<n 

X" 



Q^^r.u{x)^u{x)^p{x) V — i?"u(0). 

|a|<r 



The next theorem proves some important properties of the operators 7^0,,! and Q0_„ as well as demon- 
strating relationships between S and 5*0 

Theorem 78 Suppose p E Si^n- Then: 

i- 'Ptti.n o,nd Qiji^n OT^ continuous linear mappings from S into S. 

2. 7^0. „ and Q0^„ are projections into S which satisfy: 

'P!D,n ■ S — > pPn is onto and nuUT'g.n = 5'0^„, 
QiD^n ■ S 50_„ is onto and null „ = pP„ - 

3. 5 = 50,„epP„. 

4. S = S^^e'^n = S^n® {piD)p : p E Pn}. 

Proof. Part 1 It needs to be shown that if (pf. in S* then Vii,^n4>k ^ in 5 
i.e. x°'D^ {'P<l),n4'k) (^) ~^ x,a,f3. Since 



V,,n^,ix)=pix) ^ ^ (0) = p(x) J2 ^ 



a\ ' ^ — ' a! 

|Q:|<n |Q:|<n 
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we have using Leibniz's rule IA.l1 in the Appendix. 



(P0,„0fc) (x) 



\ \a\<n / 



|a|<n 



7</5 ^ \\a\<n ' ] 



7</3 



^ a! 

I |Q|<ri 



If </>fe ^ in then [i:>"(5, 0^] -> 
x'^Df^ {P(l,n(t>k) {x) for all x, a, (3 
Parts 2 and 3 



0, since G S". Hence {J^(ts,n4>k) (^) ^ fo'' ^-ll 2; and so 



xP ^ xl^ 



l/3|<n 



l/3|<n 



\a\<n 



Pi-) E E ^i^"0(o))(o), 



l/3|<n 



. |a|<n 



since {D°'p) (0) = for 1 < laj < n. Further, p{Q) ~\ implies 

r/3 



v,^^v,,^^ = p{x) E f E ^^"'^(0)) (o) = p(-) E i_ {^^D^^ 



|/3|<i 



I |a|<r 



(3\ \ /?! 



r/3 



(0) (0) 



l/3|<n 



and so V^^n is a projection. Hence Q$^n is also a projection, S = nullQ0 „ © range 7^0_„ and clearly 
range "Pe^n = pP„. 

Now to show that nullpB^n = Sji n- Since p(0) = 1 there exists ?- > such that p{x) > for |a;| < r. 
Hence if „0 = 



.(x) ^D'^(biO)^(bix), \x\<r, 



|Q|<n 

X°' 

and so — r^"'/'(0) = for [x] < r. Thus D"0(O) = if |a| < n, and so e S'0 „. Conversely, 

|a|<n 

S 5*0 „ clearly implies 7^0. „0 = and since 7'0_„ = / — Q0.„ we have the results 



range Q^. 
nuU Q0 , 



nuU7'0,„ = S'0_„, 
range 7^0, „ = pP„ 



3.3 The tempered distribution adjoints of V$^n a-iid Q0 „ 

The projections 7^0, „ and Q0,„ were studied in the previous section and here we will derive their tempered 
distribution adjoints „ and ,^ . These are projections into S" and several properties are proved which 
relate to their ranges and null spaces. 
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Definition 79 The distribution adjoints ^ and ^ 

The adjoints ofV$^nj Q$,n ■ S ^ S are denoted by ^, ^ and are defined for u G S' and ip G S by 

SO that ^ : S' ^ S' and ^ : S' ^ S' are continuous. 
Theorem 80 The operators ^ and Q*^ have the following properties: 
^- ^0% ^'^^ Ql,n ^"^^ projections and V^^ + Q| ,^ = /. 
2. IfuG S' then „u = Pu {-iD) 5 where 

(0 = X] e Pn, ba,u = [u, {-ix)" p] . 



\a\<n 



3. nuU „ = range P| „ = {p{D)6:pe P„} = P„. 

4. range Qg^^ = mxWV^,^ = {u & S' : [u,x'^p] = when \a\ < n}. 

5. S' = Pn® {u e S' : [u, = when \a\ < n}. 

6. ipu = tpQg ^u, where u € S' and (p G fl C^p- 

Proof. Part 1 is true since 7^0 „ and Q$^n ^re projections. 
Part 2 If u G S" and e 5 then 



u,p 



|a;|<n 



|a|<n 
|a|<n 



\a\<n 



E 

, |a|<n 



[u, x"p\ 



|a|<n 



and thus 



,\a\<n 



Part 3 From the formulas of part 2 it is clear that T'l „ : S" ^ Pn so that range „ C P„ . We 
now show that nullQg ^ = P„. If u € Pn then u = p{D)d for some G P„ and, since (p € S implies 

[20,„u,<^] = [w, Q0,„v'] = [p{D)S,Q(l),n'p] = [S,p{-D){Q(/),n'p)] 

= [p(-D)(Q0,„^)](O) 
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by the definition of 5*0. „. This means ^_^u = and hence that P„ C null ^. 

Part 4 From part 2, „u = _p„ (£>) (5 so „m = iff = iff p„ = iff [u, = when 

I a I < n. Here x was an action variable - see Notation [1] 

Part 5 Part 1 implies that S" = null Qg „ ® range 

Part 6 Suppose u e 5 and 93 G D C^p. Then ip G S imphes (pip G S'g^n and so 



3.4 Bounds for Q0^„^^ (e*(^'^)) 



In Section 13.21 the operator Q^^n was introduced and now we will derive some upper bounds for the 
function |Q0,„.5 (e*(^'''^)|, where Q0,,i.^ acts on the variable ^ in e*'^''''. These estimates will be used in 
Section 13.61 to prove an explicit formula for a basis function in terms of its weight function, and used 
again in Section [3.71 to prove an inverse Fourier transform for a member of X^. 

Theorem 81 The function Q^),n,^ (e*'^'''') has the following properties: 
1. There exists a constant Cn,~i, independent of x and ^, such that 



D 



< 



C„,,|C|l^l(l + |x|rl^l-\ |7|<n, 
ICI'"', l7l>n. 



This is a useful estimate for large x and large 
2. Given r > there exists a constant Cn,-/,r such that for all x and |^| < r 

!e.,.. (»•<-•«)! <(;;-yl«l'''' + 1^1'""'''' j^j:"' (3.1) 



This estimate is useful near C = 0. 
Proof. We first derive a formula for D^Qn^n,^ (e*^^'^)). For some p € Si^n 



a! ■ ■ ^ — ' ^ — ' al 

\a\ <n k<n |a| = fc 

p(0E'^^' 



fc! ' 



so that 



Part 1 If I7I > n then the inequality is a very simple consequence of the formula for 
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On the other hand, if I7I < n then from equations 



D2( 



< lei'^' 1+ E 

\ fc<n-|7| 
\ fc<ri-|7| 

< E 

V fc<n-|7| 



ip(oiieh^i ' 

fc! 



|p(Oliei'(i + klf 



fc! 



ip(oiicr 

fc! 



(l + |a;|r-l^l-^ 



< max 

i<n-|7l 



< 4 max 

j<n-\j\ 



\-\'p 



1^1'^' (1+ E ^)(' + '"'^' 

V fc<ri-|7| / 



-I7I-I 



n-|7|-l 



where Cn^-y = 4 max 



\-\'p 



- c„,,ie|i^i(i+Nri^i-i 

, as required. 



A;<n— I7I 

Part 2 If I7I > n the inequahty follows from part 1. There remains the case I7I < n. Using the Taylor 
series expansion about zero (Appendix IA.8|) we define the function /x^ by e** = J2 — ^ A*m(0 



and note that || Mm 1 1 00 — ^^'^ following calculations 



D 



fc<n— I7I 



k\ 



now imply that when |^| < r 

D2Q,,n,i I < lei'^' (ii - + \pm 1^1""'"' i^r 



-|7l 



<(^|^|^^ + iiHioo) lerd + N)"-'^'- 

But p e S'l^n implies 1 — p E and by Taylor's theorem f Appendix lA.Sp there exists a constant 
fcp,n > 0, independent of such that |1 — p{£,)\ < kp^n for Thus 



-|7l 



where Cn,'i,r = '''^'fcp.n + ||p| 



3.5 A useful inverse Fourier transform theorem 

The next theorem will be used in Section 13.61 to derive an inverse Fourier transform formula for a basis 
function and in Section 13.71 to derive an inverse Fourier transform formula for any member of Xf^ . This 
theorem will use the following lemma which shows how, when (j) E S, the expressions V(i)^n4' ^nd Q0.„0 
can be expressed in terms of 7^0, 2: (e'^"^^^^) and Q(ti^n,x (e*''^-''^). 



3.5 A useful inverse Fourier transform theorem 



57 



Lemma 82 If ip <E S then: 

i- {n,ni) (0 = (2vr)"^ /T'fl,,,,^ (e^(-'«)) ^ (x) dx. 



Proof. If 7/; e 5 then 



|Q|<n 



|Q|<n 



|q| <n 



7 



"0 (x) dx 



\a\ <n 



and hence 



= i2ny^ J e'^'-'i^ (x) dx - (27r)"'*/^ J Vti,,n,i (e'^^'^^) V (2:) ^a; 



To prove the next theorem we will require another lemma concerning differentiation under the integral 
sign. 

Lemma 83 (Prop 7.8.4 of Malliavm \T^)Suppose f : M™+" C and we write f{£,, x) where f e M™ 
and x £ M". Further suppose that: 

1. For each ^, f (C, •) £ C'*^' (M"). 

2. For each x, J D^f x) d£, < 00 for \a\ < k. 
Then we have 

Dt J fi^,x)d^^ J D^fi^,x)dt when \a\ < k, 
and J f{^,-)d^ e (R"). 

Theorem 84 Suppose f e S' and f e L}^^ (R''\0). Define the function fp ■^'^ - 
R'^yO. Then: 



a.e. by fp ^ f on 



1. If the action J fpcj) on 4> ^ Sijj^n defines a member of S'f^ ^, and if fp — f on 5'0^„, it follows that 
for all multi-indexes 7 



where for u G S", p„ G P„ is defined by 



(3.3) 



(3.4) 



\a\<n 



Further, Dy = [iS)'' fp on S^^^, and [i^^ fp e (R'^\0). 
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2. Now also assume that for a given multi-index 7 there exists s > and a constant fc > independent 
of ^ such that 

(3.5) 



J |d2Q0,„,4 (e'(-^«)) fF (0 \d^<k{l + \x\r . 

Then D-^f e ^^l, 

D^f{x) = (2^)-^y i^2Q0,„,^ (e^("^«)) /;^(0dC + (2^)"^i^>j(a:) 

and 



(3.6) 



(2^)-^ / Q^,n-\^u (e*^"'^^) (0 dC, l7l < 7^ 

(2^)-^/e^(-^«)(jOVF(e)de, l7l>n: ' 



[ (2^)-Ve'(-'«)(I?V)F(0rfe 
w/iere t/ie function {D^f)p -.W^ -^Cis a.e. defined by {D'^ f) p = D^f on W^\Q. 



\l\ > n, 



Proof. Part 1 We first prove equation 13.31 From part 2 of Theorem [751 we know that Q^^n ■ S 5*0 „ 
and since the current theorem assumes that fp — f on S'0 „ and that / fpcj) on £ 5*0 ^ defines a member 
of "S'g ^, we have for ip € S and the action variable ^ 



5v> 










+ 





But 



(«0^ Q0,„V'(O/F(OdC, 



and 



so that 



'0.„i^V),^ 



^V, - y Q0,„^ (0 /f (O + [Vl„ [Dyf) , . 

The next step is to simphfy the second term on the right. From part 1 of Theorem [501 



(3.9) 



.\a\ <n 



Hence 



so that 



and 



\a\<n 



n.j] 



(2^)- 



l„ [wf) -(27r) 



(3.10) 



so that 13 .91 becomes 13 . 3 


It remains to show that n't f 


fp = f on S'0^„, 













[/F,(iO''0] = [{^0^ fF,4'] as required. Also 
we are given that fp = / on R''\0 and / G Ll^ (R''\0) so fp e L,i„^ (M''\0) and {iS,y fp e {R''\0). 



3.5 A useful inverse Fourier transform theorem 
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Part 2 The next step is to prove equation 13.61 li ^p E S then since „ + Vt/i^n = I 

[DV^] = (-1)'^' [f.D'<i:] = [j.iD'^^Y] = (-1)1^1 [iQ^^niiD^i^y) 

+ (-1)1^1 [f,V^,,{{D^i^y) 

By part 2 of Theorem [7S] Qg „ : S „ and since this theorem assmnes that fp — f on Sg „ and 

that J fpcj) on G Sg.n defines a member of 5*0 ^, we have 



Also bv lXTUl with 7 = 



/,7'0.„((I?»^)J = [VIJ] ,0-^^ 
so that now 

[DV, ^] = (-1)'"' / Q0,« ((i^^V')^) (0 /i^^ (0 + (2^) 



From Lemma I82[ for action variable a; 

d r 

= (27r) 



so that 



[Dy,4^] = (2^)- 



But from the assumptions of this theorem we know the double integral is absolutely integrable. Thus 



D^pj,i^ 



D^QU (e''"'^') If iO d^j i> {x) dx + {2i:)-i 
and assumption 13.51 imphes /-DJQe.n,^ (e*^"^'*^) fp (0 d^ G Lj^c^ '^^ can conclude that 
Dy (x) = i2n)-^ j D2Q^,n,i (e'(^-«)) fp (0 d^ + (2^)"* , 



which proves [321 In addition, 

^220,n,c (e*(^'«)) /f (0 e C*^"^ for each ^, and by inequality! 
^220,n,c (e*("='«)) fp (0 e for each x. Thus by Lemma[Ml f e C^"), 
and the upper bound [X5l applied to the right side of 13.61 implies D'^ f e C^^p. 
Further, from[ 



which proves [3771 

In part 1 it was shown that Sy = fp on S'0,„ and {i^f fp £ L;^^^ (R''\0). Thus e 

-^loc (R''\0) and it is meaningful to define the function {D'' f)p. In fact [D^ f)p — (iS,)'' fp a.e. on 
R''\0 and hence [D^ f)p = (i^)^ fp a.e. which means the right side of 13. 71 implies the right side of 
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Remark 85 Equation \3.3\ can be regarded as a modified inverse Fourier transform for a subspace of 
the tempered distributions. Eauation \3.6\ can be regarded as a 'modified' inverse Fourier transform for a 
subspace of Cgp. Instead of using the Fourier transform as the argument its L\^^ restriction to R'*\0 is 
used, and instead of the exponential e^'^^'^\ the exponential has a Taylor series-like term subtracted. 
For 7 = equation \3.6\ can he written 



(/ - i27r)-ipj) (x) = (2^)-^ / Q0.„,^ (e'(-'«)) fp {^d^, 



(^f — (27r) ^ pj^ = fp the modified inverse Fourier transform can be thought of as only 



ana since 

V ' ■ - J J F 
applying to functions of the form f — (27r) ^ pj. 

The next two corollaries will be directly applicable to both basis functions and to functions belonging 
toXl 

Corollary 86 Suppose m and n are positive integers. Further: 

1. Suppose f e S' and fe L^^ {R'^\Q) . Define a.e. the function fp'.M.'^^CbyfF^fon R'^\Q. 

2. Assume the action J fF4> on (j) S'0_„ defines a member of S'q^ ^, and that fF = f on S(i)^n- 

3. Assume that if I7I < m there exist > and k-y > independent of ^ such that 

;S0,„,C fF {0\d^ <ky{l + Ixir ■ (3.11) 



Now define fp G S" by 

/ = /p + (27r)-^pj, (3.12) 
where pj G P„ is defined by \3.4\ and the subscript p G S'i_„ is the function used to define the operator 

Then fp G C^"* n S" and if \^\ < m then 

DVp (x) = {2n)-i I D2Q^,n,i (e'^^'^^) /f (0 d^ (3.13) 

f (27r)"^/Q0,„_l^l,j(e^(-^«))(zC)VF(e)d^, \l\ < n, 
\ (27r)-^/e*(-.«)(iC)VF(Orfe, l7l>n, 

f (27r)-^/Q0,„_l^l,5(e'(-.«))(7?V)F(O'^e, \l\ < n, ,^ 
\ {2n)-^ Je^(--i){Dy)p{Od^, M > n, 

and 

\Dyp{x)\<kyil + \x\r-' , |7|<m. (3.16) 
Proof. Equation 13.61 of Theorem [M] can be written 

D-' (/ (x) - {27r)-i pf{x)) = {27r)-i J D2Qo,n.^ (e^'^'^)) /f (0 d^, 

so the definition of fp implies equations 13.131 to 13.81 Theorem [Ml implies D'* f G C*^"^ for I7I < m i.e. 
/ G C(™1 Further, the upper bound 13.111 applied to the right side of equation 13.131 implies the upper 
bound EUS] and hence that fp G C^p . ■ 



3.6 An inverse Fourier transform for basis functions 

From Theorem l49l we see that when a weight function has property W3.1 the basis functions of order 
9 lie in G G Cg'^'^^^ i.e. the derivatives are bounded functions. However, for property W3.2 we only 
know that G G Cgp^^"^ i.e. G has polynomial growth at infinity but with no upper bound on the rate of 
growth near infinity. This situation will be rectified in Theorem |90] where we will use the upper bounds 



3.6 An inverse Fourier transform for basis functions 
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for \D2Q(/)^2e,^ (e*'-^'^^) | derived in the next lemma to give an upper bomid for the basis function growth 
near infinity and to prove some inverse Fourier transform formulas for the basis functions and their 
derivatives. We then explore some other consequences of these results. 

But first we need the lemma which will supply the estimates 13.51 required by Corollary [86l 

Lemma 87 Suppose the weight function w has properties W2.1 and W3.2 for order 9 and parameter k. 
Then if \j\ < [2k\ there exists a constant Cw, independent of x, such that 



w{S.)\£.\ 



29 



C^, |7| > 29. 



(3.17) 



Cw is given bv \3.20\ and only depends on the weight function w, the function p G 5*1.261 used to define 
7^0 26 o-nd on the parameters 9, k, rs which define weight function property W3.2. 



Proof. There are two cases to be considered: I7I < 29 and I7I > 29. In both cases we will split the range 
of integration into the two concentric regions defined by the sphere S (0; ra). 

We use the estimate of part 2 of Theorem I5T] for \D'f.Q$^2e,i, (e^'^^'^^)] inside the sphere S{Q]r^) and 
the estimate of part 1 of Theorem [Hi] outside this sphere. 



Case 1 I7I < 261 and I7I < [2kJ. 

l?l<r-3 



20 



< max C2e,x,r3 
\x\<2e 



2e-\f\ 




(1 + 1x1)^^-1-^1 



and the integral exists since property W2.1 is 1/w e Lj^^. Further 



DJQ, 



0,29, 



(e*(-.«))| 



\e\>r3 



^(e)iei 



26 



d£, < 



C20,,\-\^'^{l+\x\f~\-'\~' 



\-\>r3 



< C: 



28,1 



W 



,26 



\\>r 



W 



,26 



(1 + N) 



2e-h\ 



< max C29 A max 

|A|<2e ' |A|<[2kJ 



1 26 



(l + l^l) 



2e-h\ 



\-\>r 



And by Theorem [TT] the last integral exists. Adding the two estimates we get 



20,^ 



'(Olel 



29 



^-d^ < c; (1 + \x\ 



^20-|7| 



(3.18) 



where 



C'^ = max< max C2e,A, max 6*29, a, 
|A|<26I |A|<2e 



max 

|A|<L2kJ 



1 

w 



,29 



\-\>r3 



(3.19) 
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Case 2 I7I > 261 and I7I < [2k\. From Thcorcm[ 



28 



< 



\-\<r3 



,26 



il7l-2e 



|l7l 



,29 



H<'-3 



< r 



|7|-2e 







|l7l 


w 


- I- 

J w 


|.|- 




M>'-3 




1 


- / '■ 


l7l 


- H 
w 


J w\ 


|2e 




\-\>r3 





< (l + r-3) 



171-29 



|l7l 



< (1 + ra)^'' max 

|A|<L2,.J \ J W J w\ 

■\<r3 \-\>r3 



■ „ W J W\ 

\\<r3 \-\>r3 



1 



1 26 



,29 



We now combine both cases by setting 



Cw = max <^ max C29.A, max C2e,x.r3, (1 + ^'3) 




M>'-3 



w 



,29 



(3.20) 



The constants C2e,-y and C2e,-y,r3 are defined in the proof of Theorem [ST] ■ 

If we only assume the weight function has property W2 then part 1 of Theorem [SHaUows us to convert 
the definition 11.331 of a basis distribution G E S' i.e. 
formulas 13.211 of the next theorem. 



G, ( 



for all </> G 5*0.20, into the explicit 



Theorem 88 Suppose the weight function w has property W2 and let G be a basis distribution of order 
9 > 1 generated by w. Then for any multi-index 7 



D'rG,i 



^(C)iei 



(2^)- 



e 5, 



where for u € S' 



Pu (x) 



E ■ 

|a|<26' 



(3.21) 



(3.22) 



and ^ is the action variable. 



Proof. From weight function property W2.1, ^ E Lj^^ and so by Definition we have G E S' 
on S'0^29 and E L}^^ (R''\0) n 5*^ 29- ^ow set Gi. = G on R'*\0 so that Gp 



^Lc (R'^\0) n 5^ 29- Equation [Sill] now follows from equation [33] of Theorem [H with / G. ■ 

Remark 89 This result is closely related to Theorem 2.1 of Madych and Nelson Indeed, in the 

comments following Theorem 2.1 Madych and Nelson illustrate Theorem 2.1 by choosing dfi (^) = w d£, 
where w corresponds to 1/w in this document i.e. to the reciprocal of our weight function. 

If we further assume that the weight function has property W3.2 then we can apply the bounds derived 
in the previous lemma to Corollary [HE and show that every basis function G is the sum of a polynomial 
in P29 and a special basis function Gp which depends only on the choice of a function p E 6*1, «. In turn 
Gp satisfies the modified inverse- Fourier transform equations 13.241 and the growth estimates 13.251 

Theorem 90 Suppose the weight function w has property W2.1 and property W3.2 for order 9 and 
parameter k. Further suppose that G is a basis distribution of order 9 and the operator 7^0 g is defined 
using the function p E Si^n- 
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Then G e dj^P^ and we define the basis distribution Gp by 

G = Gp + {27ryipQ, (3.23) 
where pQ G is defined usina UT^ For all \^\ < [2kJ ; 

{2^)-i J Q0^„.|^|,4 (e^(-'«)) {D^Gp)p (0 dC, |7l < 26, 
{2TT)-i Je^(-'^HD-'Gp)j,iOd^, \l\>26. 



and WGp satisfies the growth estimate 



The constant Gw is given by \3.2(A 



(3.24) 



(3.25) 



Proof. Since pQ G Pg the basis distribution Definition HH implies Gp is also a basis distribution, and by 

part 4 of Theorem ED] it lies in c||p"J\ 

We now want to apply Corollary [551 with f = G. However, inspection of the proof of Theorem [551 and 
the inequality 13.251 shows that when m = [2k\, n = 26, fp = ^\.\26 ; ^7 = and s^ ^ 26 — I7I for 
I7I < L^'^J ! all tlie conditions of Corollary |51| are satisfied and we haye our result. ■ 

The special basis function Gp defined by 13. 231 of the last theorem will enable us to relate various weight 
function properties to the corresponding basis function properties e.g. the weight function is radial implies 
the function Gp is radial. 



Lemma 91 This lemma will employ the technique of Section 4-1, Stein and Weiss J^I which defines 
radial functions in terms of orthogonal transformations. 

Stein and Weiss observe that a function f is radial if and only if f (Ox) — f (x) for any linear, 
orthogonal transformation O : M'^ — > M'^ and any x E M.'^ . 

Note that an orthogonal transformation O satisfies = O^^ where (Ox, y) — (x, O^y) for the 
Euclidean inner product. An orthogonal transformation has a Jacobian of one. 



Theorem 92 Suppose the weight function w has properties W2.1 and W3.2 for order 6 and k. Then 
the special basis function Gp of order 6 introduced in Theorem \90\ has the following properties: 



1. If Pi and P2 are in Si^2e then P2 ^ Pi ^ Sil),2e o,nd 



Gp, (X) - Gp^ (x) = (2.)-'^/^ I f (^6" d^] ^^P2e. 

|q|<20 V 



2. Gp{—x) — Gp{x) i.e. Gp is conjugate- even. 



3. If w and p are even functions then Gp is a real valued even function. 



4. If w and p are radial functions then Gp is also a radial function. 
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Proof. Part 1 By part 5 of Theorem [ST] the integrands defining Gp^ and Gp^ are absolutely integrable. 
Hence 



{2^f'^ {Gp^ ix) - Gp^ {x)) = I j - p,{0 E 



a 

\a\<2e 



W 



(0 ler 



/ ((P2(e)-Pi(0) E 



X 



a' 

\a\<2e 



|a|<2e 



if the integrals on the last line all exist. However, by parts 3 and 4 of Theorem [T5l P2(0~Pi(C) € 5*0 26 



implies (pjl^) - ^ S'a^ae- But Theorem showed that if G S'o^ae then / / I'tlf^L < oo 



Part 2 



and so ^^^^f^ e i 



\a\<2e ■ / ^ IsJ l?l 



Part 3 Suppose w and p are even fimctions. Then p{—x) — p{x) and 



\ \a\<29 



a' I ... ie|2« 

|a|<26l 



Part 2 implies Gp is real. 



Part 4 First note that Si^2e contains radial functions e.g. the standard example of a distribution test 
function, the 'cap-shaped' function 

I eexp(-^), |a;|<l, 
I 0, |a;| > 1, 

lies in 51,00 = {0 G S" : (/) (0) = 1, (0) = for all a ^ 0}. 

We now use the definition of a radial function given in Lemma [HI] to prove that Gp is radial if p^ is 
radial. Now 

d^ 



Gp^ {x)^{2n)-^ J L^(-'«)-p,,(e)E 



28 ■ 
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Thus 



'(0 i^r 

and then making the change of variables r] = 5^ with drj — and ^ = 077 



26 ,k ^-.k 



i {x, rj) \ drj 



fc! J w{Or]) \Otj\ 



28 



/c=0 



fc! / w (077)1077! 



29 



since and li; are radial. Hence Gp is also radial 



Corollary 93 Assume the weight function w has properties W2.1 and W3.2 for some order 9 and 
parameter k. Then: 

1. There always exists a conjugate- even basis function. 

2. If w is even then there exists an even, real valued basis function. 

3. If w is radial then there exists a radial basis function. 

3.7 An inverse Fourier transform for data functions 

We now recall some properties of the semi-Hilbert data spaces (Definition [2T|) needed in this section. 
These results are taken from Section FOl and the relevant theorem is given in brackets. 



Summary 94 Suppose w is a weight function with property W2. If f E then f G Lj^^ (]R''\0) and 
we can define a.e. the function fp : M'' — )■ C by: fF = fon R'^\0. Further: 

1. The seminorm and semi-inner product are given by 

fFW={I.g)^,o. Jw\-\''\fFf^\f\l^,. (3.26) 

An alternative definition of X^ is 

= |/ e 5' : r/ e l«l = 0: Jw If' Ifpf < ooj . (3.27) 

Note that by part 2 Lemma \^ the condition f £ Lj^^ (R'^\0) is actually implied by £ Lj^^ for 
all \a\ = e. 

2. The functional \-\^ g is a seminorm. In fact, null \-\^ g = Pe o-nd P H Xf^ = Pg (part 3 Theorem 

3. fpES'^g with action J fpcj) on 6*0, 9. Also fp — f on Sijj^g (part 2 Theorem\27\) . 
4- X^ is complete in the seminorm sense (Theorem \37\ ). 

5. If w has properties W2. 1 and W3 for order 6 and smoothness parameter k then X^, C C^p^ ^ 
(TheoremlJU^. 
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If a weight function w has properties W2 and W3 for order 6 and smoothness parameter k, we know 
from part 6 of Summary [Ml that C Cgp ^ i.e. functions in have polynomial growth. The next 
lemma will allow us to use Corollary [86] to prove an inverse Fourier transform result for the functions in 
X^ and to derive upper bounds for the growth rate of the derivatives near infinity. 

Lemma 95 Suppose the weight function w has properties W2.1 and W3 for order 9 and smoothness 
parameter k. Then if \j\ < \_k\ there exists a constant Cw, independent of x, such that 



'(0 1^1 



26 



(C^f, l7l> 



(3.28) 



Cw is given bu \3. 3S\ and only depends on the weight function w, the function p € 5*1.28 used to define 
Qijjfi and on the parameters which define the weight function properties W3. 

Proof. There are two cases to be considered: I7I < 9 and I7I > 9. Define the constant r4 by r4 = if 
w has property W3.1 and by r4 = r^^ \i w has property W3.2. In both cases we will split the range of 
integration into the two concentric regions defined by the sphere S (0; r/C). We use the estimate of part 2 
of Theorem [HH for |i^2Q0,e,^ (e*'^'''^) | inside the sphere S (0; r/C) and the estimate of part 1 of Theorem 
[HH outside this sphere. 

Case 1 I7I < 61 and I7I < 



\i\<ri 



■(Oiei 



20 



< 



,20 



M<r-4 



Vl<'-4 



< max Ce,\,ri ) 



2(e-|7|) 



\|-l<'-4 



which exists since property W2.1 is 1/w G -^Lc- Further 



1^2 20, e,? 



d^ 



\i\>ri 



26 



< 



,29 



< 



M>r4 

{ max Ce,A 

V|A|<0 



•|>r4 



|2|7l 



,20 



max 

\\\<Ik\ 



2(0-|7|) 



|2|A| 

"ri20 



(i + NI) 



|.|>r4 



2(0-|7|) 



and since w has property W3, the definition of r4 and Theorem 1111 implies the last integral exists. 
Adding the last two estimates we get 



26 



where 



— max < max Ce.x, max Ce^x^n \ max 



|A|<0 



|A|<0 



|A|<L«J 



|2|A| 



,20 



•|<r4 



H>r4 



(3.29) 



(3.30) 
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Case 2 I7I > 61 and I7I < [kJ 

|2 - I |2|7| , I |2|7| 



H<r4 M>r4 
I |2(|7|-e) 1 , 



|2|7l 



w 

M<r4 M>r-4 



I i2e 



< 2(|7|-e) 

^ ' /I 



1 



M<r4 M>r4 



|.|2|7l 
I |2e 



1 



|.|2|7l 

I |2e 



•|<r4 M>r4 



|2|A| 



•|<r4 M>r4 

Since property W2.1 requires that Xjw G L;\,^and property W3 implies Theorem [TTl it follows that 
the last two integrals exist. We now combine both cases by setting 



Cu, = max /max Ce A, max Cff A r4, (1 + 7'4)^''l max ( / h [ ^ ^ „„ (3.32) 

\\\\<0 \x\<e J |A|<L/.J J w J wl.PM 



w I 

l<'-3 M>r3 



so that inequalities 13.291 and 13.311 imply the 

The constants Cg^x and Ce,A,r4 are defined in the proof of Theorem [ST] ■ 

The next theorem is our inverse Fourier transform result for distributions in when the weight 
function has property W2. 

Theorem 96 Suppose the weight function w has property W2 and suppose f € X^. Summary \94\ allows 
us to define a.e. the function fp : C by fp = f on M'^\0. Then for all multi-indexes 7 



Dy, = y {zO^ Q0,e^ (0 fp (0 + (2^) ^ [Dfp^^,i;^ , i; e S, (3.33) 

where for u G S' , Pu G Pe and 

Pu (x) = V = [u, (-^0" P] . (3.34) 

|Q|<e 

Proof. If / e then by SummarylH/ G S", / G L^^ (K'*\0), /f G S^.g with action/ /f0 and /f = / 
on 50.6/. Hence / satisfies the assumptions of part 1 of Theorem [84l and l 3 .31 and [3^ implies 13.331 and 13 .341 
■ 

If a weight function also has property W3 for order 6 then we have the following modified inverse- 
Fourier transform theorem for the (continuous) functions in X^ as well as an upper bound for the growth 
rate 13.371 of the derivatives near infinity. More precisely, a function in X^ is shown to be the sum of 
a function fp e X^ and a polynomial in Pg and the function fp satisfies the modified inverse-Fourier 
transform equations 13.361 

Theorem 97 Now suppose the weight function w also has properties W2 and W3 for order 9 and 
smoothing parameter k. Then X^ C C^p\ Now define the function fp € X^ by 

f^fp + {2n)-ipj, feXl (3.35) 
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where pj G Pe is defined by \3.34\ and p £ Si^n is used to define V^^g. Then fp — Q^^f £ C'bp^'' H X, 



and for < k: 



(2vr)- 



{2n)-i J Q^M-\yU (e^^"'*^) (*0^ If iO d^, l7l < 6 
{2n)-^ fe^(-'iH^O''fF{Odt h\ > 6 

(27r)-^/e^(-.«) {Dyp)^{Od^, 



> 



(3.36) 



and D'' fp satisfies the growth estimates 



\D-'U{x)\< 



C'lu l/pl 

Ctii l/pl 



h\ > 0, 



(3.37) 



where the constant Cw was defined in Lemma 



Proof. This proof is an application of Corollary[Sn]with n = 9 and m = [kJ . If / e then by Summary 
IMl f £ S', f e L\^^ (M''\0), fp & S'q g with action/ fp(f> and /f = / on S'g^g so / satisfies assumptions 1 
and 2 of Corollary 1861 Regarding assumption 3: using the Cauchy-Schwartz inequality 



d: 



d^ = 



< 



vMOier 

,26 



VMf)\^ffFiO 



d^ 



-dn i/L 



since |/|^ ^ = fw\-f'^ |/f|^ d£, by part 1 Summary[ 



^(oicr 

Applying the inequality derived in Lemma [ 



for I7I < [kJ we get 



'(0 1^1 



28 



< 



c^^i/u(i+kir'"' 

\ f\w.S ' 



l7l< 
l7l> 



Inequality [HUSl of Corollary [HSl is now satisfied for = \ f\yj g and = max{0, 9 ~ I7I} and so the 
rest of Corollary [86] can be applied to obtain / G C^p^^ and all equations and estimates for D'^ fp except 

_____ _ d 

equation 13.361 where fp has replaced /. But by 13.351 D'' f — D''fp + {2n) ^ ^''Pf ^-^d since D'^pj is a 
polynomial we have [D'^ fp)p — {D''f)p. m 



Remark 98 This result is closely related to Proposition 2.2 of Madych and Nelson ]13f . However, in the 
comments following Theorem 2.1 Madych and Nelson illustrate Theorem 2.1 by choosing dp, (^) = w (^) 
where w corresponds to l/w in this document i.e. to the reciprocal of our weight function. 
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The basis function interpolant and its convergence to 
the data function 



4.1 Introduction 

The goal of this chapter is to derive orders for the pointwise convergence of an interpolant to its data 
function as the density of the independent data increases. 

Section by section: 

Section l4.2I The concept of unisolvent data sets and minimal unisolvent data sets is introduced together 
with the Lagrangian interpolation operator V and the operator Q ^ I — V which are defined using a 
minimal unisolvent subset of the data. 

Section l4.3I Smoothness results and upper bounds are obtained for the operators DJQx (e*'^^'"'') . These 

are then used to estimate an upper bound for J - — ""^^^S^^^^aa where w is the weight function. 

Section The properties of the function (e*^^'^^) are used to derive an 'inverse Fourier transform' 
theorem which expresses the value of a function / e in terms of its distribution Fourier transform, 
which is a function in Lj^^ (K''\0) . 

Section 14. 51 The data function space X^, is endowed with the Light norm which is based on a minimal 
unisolvent set. We then derive explicit formulas for the Riesz representers of the evaluation functionals 
/ D'' f [x) where / G X^. These formulas are expressed in terms of a basis function. The existence 
of a Riesz representor of / — )■ / [x) means that X^ is a reproducing kernel Hilbert space of continuous 
functions. 

Section 14.61 In this section we define the unisolvency matrix and the cardinal unisolvency matrix, 
as well as the basis function matrix and the reproducing kernel matrix. These matrices will be used to 
construct the matrix equations for the interpolant as well as the smoothers studied in later chapters. 

Section 14.71 The finite dimensional space Wg,x is introduced and some properties proved. This space 
will contain the solution to the interpolation problem of this chapter and to the smoothing problems of 
later chapters. 

Section 14.81 The vector- valued evaluation operator £xf = (./ (a;*-'^-')) is studied. This operator and its 
adjoint will be fundamental to solving the interpolation and the smoothing problems. 

Section 14.91 The minimal seminorm and norm interpolants are defined and shown to have the same 
basis function solution in Wg.x- The concept of a data function is introduced and several matrix equations 
for the smoother are derived. 

Section l4.10l We obtain estimates for the order of pointwise convergence of the interpolant to its data 
function. 

Section 14.111 The convergence estimates of the previous section are improved using Taylor series 
expansions of distributions. These results are applied to the thin- plate splines and the shifted thin-plate 
splines. 

I have not included the results of any numerical experiments concerning the interpolant error estimates. 
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4. The basis function interpolant and its convergence to the data function 



4.2 Unisolvency: sets, bases, operators and matrices 

The concept of unisolvent sets of data is fundamental to the theory of basis function interpolation for 
orders 9 > 1. The basic importance of unisolvency is that it ensures that the interpolation problem 
has a unique solution. Using minimal unisolvent sets we will then construct the Lagrange polynomial 
interpolation operator V and the operator Q = I — V as well as the unisolvency matrices. 

In Subsection 14.5.21 following Light and Wayne [TT], a unisolvent set of points will be used to define 
an inner product on the space Xf^ . With this inner product we will show that Xf^ is a reproducing kernel 
Hilbert space. But first we need to define unisolvency and some related concepts. 

Definition 99 Unisolvent sets and minimal unisolvent sets 

Recall that Pg is the set of polynomials of order 6 i. e. of degree 6 — 1 when 9 > 1. 
Then a finite (ordered) set of distinct points X — {xi} is said to be a unisolvent set with respect to 
Pe if: p € Pe and p{xi) ~ for all xi ^ X implies p = 0. 

Sometimes we say X is unisolvent of order 9 or that X is 9-unisolvent. 

It is well known that any unisolvent set has at least M — dim Pg points, and that any unisolvent set of 
more than M points has a unisolvent set with M points. Consequently, a unisolvent set with M points 
is called a minimal unisolvent set. 

It is convenient to introduce cardinal bases for polynomials and permutations together. 

Definition 100 Cardinal bases for polynomials and permutations. 

1. A basis {li\^Li for Pg is a cardinal basis for the minimal unisolvent set A = {fli}^]^ ifh {aj) = 6ij 
and the U are polynomials with real valued coefficients. 

2. We will call the column vector I — ili) the cardinal basis (column) vector and we will write I a 
to make the dependency on A explicit. Evaluation at a point x will be indicated by I a {x) . 

3. It is well known that a set is minimally unisolvent iff there exists a (unique) cardinal basis for 
the set. Also, re-ordering A re-orders {li\^Li identically i.e. It^[a) = i^A^ = II/^i where n is a 
permutation and 11 is the corresponding permutation matrix. A permutation n can also be thought 
of as a sequence of indexes such that if {y'-'-'} = vr (X) then y^'^ — x'-'^'-*^^. 

4- When used as a vector an ordered set is regarded as a column vector by default. Re-ordering by 
columns involves left-multiplication by 11. Re-ordering a row vector involves right-multiplying by 



5. The inverse permutation is denoted tt ^ and has permutation matrix . Thus Il^Il = HH^ = I. 
4-2.1 The Lagrange interpolation operator V and Q = I — V 

Now we have conditions for the continuity of functions in X^, we can introduce operators, norms etc. 
which involve evaluating these functions at points. Following Light and Wayne, the first step is to 
introduce the operators V and Q, which will play a pivotal role in the remainder of this document. Light 
and Wayne introduced the Lagrange polynomial interpolation operator V as equation (7) following 
Lemma 3.4 as well as the operator Q = I — V . 

Definition 101 The operators V : C'^*'^ Pg and Q : C^''^ C^^\ V is the Lagrange interpola- 
tion operator. 

Suppose the set A — {ai}f£i "is a minimal unisolvent set with respect to the polynomials Pg. Suppose 

cardinal basis of Pg with respect to the unisolvent set of points A. 
Then for any continuous function f define the operators V and Q by 



M 





(4.1) 



i=l 



where the unisolvent set can be used as a subscript when necessary. 



Theorem 102 The operators V and Q have the following properties: 
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1. p (z Pe implies Vp ~ p and hence Qp — 0. 

2. For all ai G A, {Vf){ai) — f (ai) and {Qf){ai) — 0. The polynomial Vf interpolates the data 

3. V'^ = V, VQ=QV = Q and ^Q^ soV and Q are projections. 

4. null Q — range = Pe- 

5. V and Q are independent of the order of A. 

M 

Proof. Part 1 is true since each member of the cardinal basis satisfies Vlj = {ai) U — Ij and part 

1=1 

2 is true since U {aj) — Sij. Regarding part 3, is a projection since 

(M \ M M 

Thus VQ = V {I -V) = V - = = [I - V)V = QV, and so ^ Q{I - V) = Q. Finally 
part 4 is true since V + Q = I . Part 5 is true since from the definition of unisolvency reordering A 
reorders {li}fiLi identically. In terms of permutations (recall Definition llOOp . if we write Va and define 
the vector-valued evaluation function by 5a/ = (/ (o-i)) then 

rj^ rj-r rj~r rj-i 

V^[A)f [x) = [£.(A)f) K(A) (x) = [niAf] TUa (x) = (SAf) TI^TITa (x) = (SAf) Ta (x) 

= VAf (x) . 



4-2.2 Unisolvency matrices 

This section builds on Section which introduced the concepts of unisolvent sets, minimal unisolvent 
sets and cardinal bases. In this section we define the unisolvency matrix and the cardinal unisolvency 
matrix which can be used to characterize unisolvent sets in a form suitable for studying the interpolation 
and smoothing problems of this series of documents. 

Definition 103 Unisolvency matrix and cardinal unisolvency matrix. 

Suppose {pi}fLi is any basis for the polynomials Pg and we have an arbitrary ordered set of distinct 

points X = {x^^^}^^^ C W'-. Clearly we must have N > M = dimPg. 
The N X M unisolvency matrix Px is now defined by 

Px ^ {p, {x^'^)) ■ (4.2) 

For example, for numerical work we may use the monomials {x"}^^^^g as a basis for Pg. 

Now suppose the subset A <Z X is minimally unisolvent and has cardinal basis {lj}'^^i. Then we use 
the special notation 

= (4.3) 

for the unisolvency matrix which corresponds to the basis {Ij}. We call Lx a cardinal unisolvency 
matrix. 

As well as proving some elementary properties of unisolvency matrices, the next theorem introduces 
some matrix notation which will be used often later. It will be noted that there is an emphasis on 
characterizing the set nuUPj. This is because the constraint P^v = is part of the definition (Definition 
I130p of the finite dimensional space Wg,x which contains the interpolants studied in this document. We 
now prove two theorems of properties of the unisolvency matrices. The first theorem proves results which 
are true for any minimal unisolvent subset of X . The second theorem assumes the first AT points of X 
constitute a minimal unisolvent subset. 
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Theorem 104 Properties of unisolvency matrices Suppose X = {^'''li^i '^'^2/ set of distinct 
points in Mf^ . Then if M — dim Pg : 

1. The null space of the unisolvency matrix Px can be used to characterize unisolvent sets. In fact, 
X is unisolvent if and only if mill Px = {0}. 

Now suppose the set X is unisolvent and A = {ai}f=i '■^ ^'^2/ minimal unisolvent subset. Then: 

N 

2. P^P ^OiffJ2 PjP i^^'^) = for all pe Pe. 

3. Suppose Px and Qx are the unisolvency matrices generated by the bases p = {pi}fti and q = 

of Pg. Let R be the regular change of basis matrix i.e. p — Rq. Then 

Px = QxR^ = QxQa'Pa, 



where Pa = {Pj '^'^'^ Qa — {qj (cti))f^=i '^'"^ regular. Further 



= 

Px - LxPa- (4.4) 



I P^(3^0iffLl(3 = 0. 

5. dim null P^ = dim mill L"^ = N - M . 

Proof. Part 1 If p G Pg then p = PiPi for unique /3j. Thus the condition = for all 

1=1 

j = 1, . . . , N is equivalent to ^ P^pi (a;'-')) = for all j = 1, . . . , TV which by definition 14.21 is equivalent 
to PxP = 0. 

N N 

Part 2 Since = = (i^p, (x^^)) and {p-^jZ^ is a basis for Pg, it follows that J2 PjP {x^^^) = 

i=i ^ j=i 

for any p Cz Pg. Clearly the argument is reversible. 

Part 3 If p = (pi) and q = (qi) are the basis vectors then there is a regular change of basis matrix 
R such that p^Rq. Then (p)'^ = {qf R^ so that {pf (x^^)) = {qf (a;(j)) R^ i.e. Px = QxR^ which 
implies Pa = QaR^ and so Px = QxR^ = QxQa^Pa- If we chose (q) to be the cardinal basis i.e. 
qi — U it would follow from part 1 Definition II 001 that Qa — [Ij (aO) = ^ and so Pa would be regular. 
Thus in general Qa is regular and Px = QxQa^Pa- By definition 14.31 choosing (q) to be the cardinal 
basis would also imply Qx = Lx and so Px — LxPa- 

Part 4 By part 3, Px — LxPa and the regularity of Pa implies PxP = iff L'^f] = 0. 

Part 5 That dim null — dim null L J is clear from part 4. Next observe that dim null i^f = N — 
rank i^f — N — rank Lx • Now recall the discussion of permutation operators and matrices in Definition 
llOOl Let TT permute X so the first M elements of X lie in A. Then rankix = rankL7r(x) and since the 
first M rows of L.^(^x) are li (aj) they compose the unit matrix and we can conclude that ranki^(-x) = M 
and dim null = N — M, as claimed. ■ 

Theorem 105 Properties of unisolvency matrices Suppose X — {^^'''j^j^ is a unisolvent set of 
points in R*^ and Xi — {x^^^}'^^^ is a minimal unisolvent subset. Set X2 = 'P^^''^' 

1. The cardinal unisolvency matrix w.r.t. Xi is Lx = ^ ^ where Lx2 — {Ij i^^^'')) j * > ^'so 

N 



2. Suppose 13=[L \ where G /?" € K^"^. Then 
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5. Define the N x N matrix Lx-o = {Lx On.n-m) ■ Then LxflLx — Lx and {Lxiof — Lx 



0- 



Proof. Parts 1 and 2 Since by definition Lx = {ij (a;^*^)) and by definition Ij (a;^*)) = Sij when 

i < M, we obtain the block form Lx = I V The rest of the theorem follows easily by observing 

V Lx^ ) 

that = /?' + L\^0'. 

Part 3. Lx-fi = (Lx On,m-n) = ( r!^ ) , and so 

\-'^^2 '^N-M J 



Further 



(Lx of^ r^ O \ Im O \ Im O 1 ^ 
\Lx2 On-m J \Lx2 On-m J \Lx2 On-m J 



4.3 Properties of the function Qx (e*^^) 

The operators V and Q were introduced in the previous section and defined using a minimal unisolvent 

set of points in M.'^. In this section we study the fmictions DJQx (e*^^) and obtain smoothness results 
and upper bounds, both near the origin and near infinity. Finally, the function DJQx (e*^^) is related 

to the weight function by an upper bound for J - — - — ^|^2e — ■ These resiilts will be used in the next 

section to derive an 'inverse Fourier transform' theorem which expresses the value of a function / G 
in terms of its Fourier transform on IR''\0. 

The next theorem derives some smoothness properties of the function (e*^^) . 

Theorem 106 Suppose 6 > 1 is an integer and M = dim Pg . Let be the cardinal basis polynomials 

of Pe associated with the minimal unisolvent set A = {ai}-^-^. Then 

M 
i=l 

and Qx (e"^) has the following local properties. 

1. Qx (e"€) = when x G A. 

2. If < e, then for each x, D^Qx (e«€) e C^g n Cg". 

3. If |/3| < e, then for each x, D^Qx (e"«) e C^g D Cgp. 

I If \a\ = and < 0, then for each x, {i^f D^Qx (e'^«) € C^^g n C~p. 

Proof. Part 1 Follows directly from the fact that k (a^) = 6a, 0- 
Part 2 Clearly, for each x, Qx (e-*^«) e C°°. Since 

M 

D^Qx (e--€) = {-ixf e--« - ^ {-ia^f e--*€/,(a;), (4.5) 
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when ^ = 

when \P\ < e. Hence for each x, D^Q^ (e""?) € C^g. 
Part 3 Suppose < 6*. 

/ M \ M 



i=l 



Again noting Theorem [13 since e is in Cg^Q as a function of ^, proving that the second factor of 
the last term is in C^g for any fixed x proves the result. In fact, if I7I < 9 and 7 ^ /3, at ^ = 



M \ M 



= {DPv.[{y - xf]] 

= -M{D'i[{y^xy]] 



y=x 
y=x 



0, 



since 7^/3. There remains the case of 7 = /3, but this follows easily using the same technique. 

Part 4 Suppose \a\ = 9 and |/3| < 9. First observe that by theorem [13 (i^)" ^ ^nd since it was 
shown in part 3 that for each x, D^Q^ (e"*'^^) G C^g, this part is proved. ■ 

To prove the next result we will require the following lemma concerning differentiation under the 
integral sign. This result is Proposition 7.8.4 of Malliavin [T3]. 

Lemma 107 Suppose f : C and we write f {£,,x) where ^ G M™ and x G M". Suppose that: 

1. For each ^, f •) e C^^) (R"). 

2. For each x, J D'^f {£,,x) < 00 for \a\ < k. 



Then when \a\ < k we have 



and J f{C,-)dC e CC^) (M"). 



I f{i,x)d^ = I D^f{i,x)d^, 



In the next lemma we elucidate some of the structure of the function Qx (e"?) studied in the previous 
theorem. 

Lemma 108 Suppose the operator Q is generated by the minimal 9 -unisolvent set A — {a^}^]^ and the 
cardinal basis {h}f^i- Then: 



S.(e"^)- E ^"(^'^)^' (4.6) 



where 
and 

pit /■! 

I -ist„e-i. 



W = (^3Yyy e-^^'s'-'ds, t e 
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2. fig £ (R) and \\D''fig\\^ < ^ for all k. 

3. For each x, (x, •) G C^p (R'^) and for each ^, (•, C) G Cbp i^"^) ■ 
Also, for all \^\ < 9 

\Dlv^ {x, 01 < (21^1 + \A\ CA^^) (1 + lei)'^' (1 + , x,^e R^ 

where \A\ and CA,-y are defined by \4.13\ and \4.lS\ of the proof. 

Proof. Parts 1 and 2 Wc start by expanding e**, i £ M about zero using Taylor's theorem with 
remainder, as given in Appendix IA.8[ and then substitute t — x^ to obtain 

= pe {txO + ^'7^ ' , / e-'^-^s'~'ds, (4.7) 



(^-1)! Jo 

where pg £ Pg. For notational compactness set 

flg{t) = j^^j\-'''s'-'ds, teR. 

Next observe that fig e C^p, since fig is e'* times the Fourier transform of a bounded Lj^^ function 
with compact support. Further, since the derivatives of the integrand which defines Hg are functions on 
R, Lemma [1071 enables us to differentiate under the integral sign and this implies that all the derivatives 
are bounded i.e. fig € . In fact, for any integer A: > 



so that 



D^figio)^ (0^= k^ie-iy._ (.fM 



and 



{k + ey. {k + eyr 

We now rewrite 14.71 as 

e'-^ =pgi^xO + i^xO%eH)■ (4-8) 

But for given ^ pg (ix^) is a polynomial in x of degree less than 9, so by part 2 of Theorem 11021 
Qx (pe (ixO) = for aU x. Thus 

Qx{e"^) - Qx{{^^xff^g{xO) (4.9) 

= E ^2.(xV,(xO)(^e)" 

= E «a(a:,0(*0", (4.10) 
where we have defined the functions by 



Vc.ix,0 = -,Qxix''figixO), \a\ = 0. (4.11) 
a! 
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Part 3 Since e (M), for each x, {x, •) e C^p {W^) and for each ^, (-,0 e C'^p (K"*)- 
Now {Zi} is the cardinal basis corresponding to the minimal unisolvent set A — {a^j^lj^and there exist 
constants ca,7 such that 

M 

Wl ^ (1 + : l7l < 0, ^ e M'*. (4.12) 

1=1 

Also define |^| by 

|^|=max|afc|. (4.13) 

k 

We now differentiate equation [4TT] of part 1 with respect to x. 

a! 

A/ 



( (a;0 - V (a*)" Me (ozC) (a^) ) 

M 

-DZ (xV, (xO) - E Me (a;) 



M 



/3<7 ^'^Z i=l 
/3<a 



/3<7 

/3<Q 



V (a,)" Me (flif) D'''k (x) . 

i=l 

since |£''''Me (0| — if for all integers 6* > 1, we have 



[3<a 



^ Ef«)N'"'"l^l'^'"'" + l^l^-^.(i + N)'"'^'"^ 

/3<7 

^ E Q (1 + I^D' (1 + 1^1)'" + 1^1 (1 + 1^1) 



d-h\~i 



/3<7 

= 2l^l (1 + |x|)^ (1 + ICD'^I + |A| c^,, (1 + |x|)^-l^l-i 

< 2H(l + |x|)^l + |e|)l^l+|A|c^,^(l + M)' 

< {2\-<\ + \A\cA,,)il + \x\fil + \C\)^-'r 



Theorem 109 Suppose the operator Q is generated by the minimal 6-unisolvent set A = {0^}^-^ and 
the cardinal basis {h}fLi- Then for x,^ £ M."^: 

1. For all 7 we have the simple but useful estimate 

M 

\DIQ, {e^^^)\<\i\^-'^+Y.\{Dnu){x)\. 



2. For all 7 

' k,,AA^ + \Af\^f{^ + nP, i7i< 

lei''^', l7l> 



This inequality is useful for ^ near the origin. 
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3. For all 7 

k'Al + \x\f-'-\^\{l + nP, |7|< 



\DIQ^ (e"«)| < 



1^'"' , l7l > 0. 



This inequality is useful for all x or for when ^ is large, as the estimates have lower powers than 
those in part 2. 

The constants k-y^A,0 cind k'^ ^ are defined in the proof. 
Proof. Part 1 By definition of 

M 



k=l 

SO it follows that 



k=l 



Part 2 Since I7I < 6, we can apply the estimate of part 3 of Lemma 11081 to the formula 14.81 for 
(e"«) of part 1 of Lemma [Ml 



J2 DZv^{x,om'' 



\a\=e 



J2 (2l^l+|A|c^,,) (l + |x|)^l + |e|) 



\a\=e 



< E 1 (21^1 + 1^1 CA.,)(1 + N)' 1^^(1 + 1^1)1^1 

\H=e J 
= fc,,^,,(l + l^l)'lCl'(l + iei)''^', 

where kj^A,e = (j2\a\=e (2'''' + 1^1 ^^,7) and \A\ and ca,^ are given bv l4.13l and 14. 121 

On the other hand, if I7I > 0, {DJQ^ (e*=^«)| = \C\ < ICl'"^'- 
Part 3 From part 1, if I7I < 61 



M 



\D2Q, (e-«) I < lei'^l + ^ liD-^h) {x)\ < (1 + Id)'"' + CA^, (1 + \x\)' 

k=l 

< 2max{l, CA,^} (1 + 1^)1^1 (1 + IxD^^^-l^l 

= fc;.A(i+iei)'"'(i+N)'-'-'"', 

where fc!!^ ^ = 2 max {1, CA,'y}- 

On the other hand, if I7I > 9, we use the result of part 2. ■ 

The next theorem uses the previous theorem to relate the function DJQ^ (e~*^^'^^), discussed above, 
to a weight function of order 9. 

Theorem 110 Suppose that the weight function w has properties W2.1 and W3 for order 9 and n, and 
that the operator Q is defined using a minimal unisolvent set A of order 9. Define r^ by = if w has 

property W3.1 and r^ = ra if w has property W3.2. Then for each x e R'^, ^^^|^|26i — ^ G whenever 
I7I < K. In fact, there exists a positive constant c^, independent of x, such that 

|2 



^ r {c^f{i + \x\r, i7i< 



w\-\ 



< ^ 2^^ ' ' ' ' (4.14) 

[Cw) , I7I > ^, 
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Proof. We want to show that for each x, J^i-i" — ^ whenever I7I < k. We start by sphtting 
the domain of integration in the manner used to define the function There are two cases: I7I < 6 and 
I7I > 9. Set m = mm{e - 1,k}. 



[Case 1 I7I < 9, \-f\ < k\ p^rt 2 of Theorem [IM] imphes 



|.|<r4 



(e'(-'-))|^ ^ r (fc,,A.M^i + M)'"'(i + N)^)' 



|.|<r4 



/ 



w 



\|-|<^4 

< (1 + rA'^'^ I max Ae 
\h\<e 



^ [ il + \x\f\ (4.15) 
w 



■\<ri 



which exists since property W2.1 is 1/w E Lj^^. Next we use part 3 of Theorem [T 



|.|>r4 



< 



|.|>r4 



/ 



1,A) 



\\>ri 
( 



W 



1 28 



(1 + N) 



2(8-l-|7|) 



1 



2^1-1 (fc;^) 

< 2^^^ I max fc', A ] max 



|2|7l 



,20 



(1 + N) 



20 



2 ( 



\\l\<0 l7l<'= 



1 + M"^' I 20 

(1 + N)'', (4.16) 



\|-l>^ 



w 



,20 



which exists by part 2 of Theorem [TT] Combining 14.151 and 14.161 we have the estimate 



w 



,20 



(4.17) 



where 



c' = max < 2" max k' /> , (1 + »'4)'' max k^ a 01' max 
' h\<0 ^' \i\<0 ' J l7l<« 



1 /■ 1 



|2|7l 



\\<ri |-|>r4 



,29 



(4.18) 
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[Case 2 I7I > 6, I7I < ij \]^{^g part 2 of Theorem [TM] wc obtain 



w 



,20 



< 



w 



,20 



M<r4 M>r4 
I |2|7|-2e 



,29 



|2|7l 



,20 



M<r4 



< (^4) 



M>r4 
1 



|2|7l 



< (l + r4) 



|.|<r4 M>r4 



2171-28 



:2e 



|2|7l 



\|-|<'-4 \-\>ri 



,26 



< (1 + r^) max 

|7|<K I J w J w\ 
■\<ri \-\>ri 



1 



1 



|2|7l 



,20 



(4.19) 



since I7I < k. We can now combine the results of the two cases by defining the constant to be 

|2|7l 



Cw = max < 2*^ max k' 4,(1 + r^) max kry g, (I + r^) > max 

' l7l<e ^' h\<0 ' ' 'J |7|<K 



1 



1 



•|<r4 M>r4 



,20 



(4.20) 



and so from l4.17l 14. 181 and l4. 191 obtain the estimates [HH] of this lemma. The constants k'^ ^ and k^,Afi 
are defined in Theorem 11091 ■ 



4.4 An inverse Fourier transform result for functions in Xt, 



w 



In this section we use the properties of the function (e*^^''^^) derived in the previous section to derive 
an inverse Fourier transform theorem which expresses the value of a function / S in terms of its 
distribution Fourier transform which is a function in L^^ (R'^\0). 

Summary [TTT] will now recall some results about the semi-Hilbert data space 



< 00 for all \a\ = 9 



with semi-inner product and seminorm 



\a\=0 



introduced as Definition [ 



Summary 111 Suppose the weight function w has property W2. If f & then f G Lj^^ (R''\0) and 



we can define the function ff 



a.e. by fp ^ f on R'*\0. Further: 



1. The 



seminorm 



\'\w satisfies (part 1 Theorem \25\) 

J «^i-ri/^^i' = i/i: 



(4.21) 



2. The functional 



IS a seminorm. 



In fact, null g = Pb and X^ O P = Pg (part 3 Theorem 



3. fF = iff f e Pe (part 1 Theorem]^. 
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4- fp^SLg and f = fp on S^ g (part 2 Theorem 



5. Since the weight function has property W2 we can use the definition of from Corollary \ 
namely 

Xi = (/e5':/eLi<,,(M^0), [ w\-\'' \f F\'<^,\a\^e implies Cl^efp on S 



(4.22) 

Note that this definition makes sense because the conditions 

/e L\^^ (K''\0) and J w < oo imply (part 2 Coroll ary ^ that when \a\ = 9, Cfp is a 

regular tempered distribution in the sense of part 2 Avvendix \A.5.1\ 

6. X^ is complete in the seminorm sense (Theorem \37\ ). 

7. If w also has property W3 for order 9 and smoothness parameter k then X^ C Cgp"^ (Theorem 

Lemma 112 Suppose the weight function w also has property W2. 
Then for all f £ X^ and all multi-indexes 7 > 



where the function ff 



i"^ IS defined a.e. by fp^J on W^\Q. 



Proof. If I7I < 9 then from part 2 Theorem [TO6] we have D^Q^ (e*'^'' )) £ C^g n C^p. 
If I7I > 9 then DIQ^ (e'(^'«)) = {iCf e'^^''^ and by part 3 Theorem[15l 

DIQ^ (e'(^^«)) e C^g n C^p for each x. Again by Theorem [HI (jyDJQ^ (e*(=^' )) G S'0,e if e S*. In 
addition, from part 4 Summary 11111 fp £ S'f^ g and f — fp on S^ g. So for e S* we now have 



.fp,<P 



which proves this lemma. ■ 

The next theorem is an inverse Fourier transform result for functions in X,^ 



Theorem 113 // the weight function w has properties W2.1 and W3 for order 9 > \ and k > then 

^lii ^ ^BP ■ ^ 

Further, if f & X^, fp = J on x £ R"^ and I7I < [k\ then 

{DIQ, (e'(-. )))/peLi and 

Dy {x) = {2i,)-i J [dIQ^ (e^(-'«))) fp {£) d^ + (D-^Vf) (x) , (4.23) 
and we have the growth estimates 

\Dy (x)\<i + 1^1)' + 1^^'^^) ' < ^' (4 24) 

\ \f\w,e> h\ > 

where Cw is defined in Theorem \ll(A 

Proof. First note that fp e L]^^ (M''\0) implies 

{D2Qx (e^^"^''^)) fp G Ljg^ (R'^\0). For each x, we apply the Cauchy-Schwartz inequality to obtain 



< 



w\r\fp\ 

2\ i 



,20 



I/I 



(4.25) 



4.5 Riesz representers for the functionals u D''u (x) 
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and the last integral exists by inequality 14. 141 of Theorem 1 1101 From Lemma [1121 for each x, 



M 



Now set = f (• + a;)- E D^h {x) / (• + a^) so that for each x, e S' and .gi = D^Q^ (e^^^^'^) / G 



L^. But by Lemma HHl Chapter [H if u € 5' and u G i\ then u e and u = (27r) '^/^ / e'('«)M(0d6 
Thus, D^J (• + a;) - E / (• + a») -DT^, (x) € Cjj"^ and 

DV {■ + x)-Y.f{- + a{) D''k {x) = (27r)-^ / e'(-«)i?2Qx (e*^^'^') fp (0 ^^C, 

2—1 

which imphes 

Dy (x) = (27r)-^ 1 Z?2Q. (e'(-'«)) /^^ (0 + D-'Vf (x) , 
which proves [4.231 Now we use the Cauchy-Schwartz inequality to get 

\D-'fix)\ < (27:)-^ J\D2Q.[e^^^-^i^)fF{0\d^+\D''rfix)\ 
J y/w\-\ 

Substituting inequality 14.141 of Theorem IllOl yields 

which proves inequality 14.241 ■ 

4.5 Riesz representers for the functionals u D^u [x) 

Suppose that the weight function w has properties W2 and W3 for order 9 and k. Then the functions 
in are continuous. In this section we will derive simple explicit formulas for the Riesz representers 
of the evaluation functionals / f [x) where / S Xf^ and I7I < k and X^ is endowed with a special 

norm called the Light norm. When 7 = the representer is denoted by and D^Rx is shown to be the 
Riesz representer for the evaluation functional (x) when I7I < [kJ. The formula for Rx is exhibited 
in equation 14.351 and is expressed in terms of a basis function and the cardinal polynomial basis used 
to define the norm. The existence of Rx & X^ means that X^ is a reproducing kernel Hilbert space of 
continuous functions. 

The approach to deriving the Riesz representers is to first introduce a special subspace of X^ in the 
next subsection and then to deduce the form Rx must have from the definition of Rx and its implications 
for this subspace of functions. The operators V and Q introduced in Section 14.2.11 are also useful. 

4-5.1 The functions G * Sdi^e 

We will now prove some properties of the space of functions, denoted by G * S'g.e, having the form G * (f 
where £ Si^^g. Here Siji^g denotes the Fourier transforms of the functions in 5*0, 9. In the next section these 
functions will help us deduce the precise form of the Riesz representer of the functionals / D" f {x). 
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Corollary 114 Suppose the weight Junction w has property W2, and suppose G is a basis distribution 
of order >\ generated by w. Then ip G 5*0 g implies G * (p E and 



\G*(p\. 



,29 



(4.26) 



Also 



(4.27) 



Proof. The first step is to show that G*ip C X^. Let g — G*Lp where ip S S'a^e- To prove that g £ X^ we 
use definition Em of X^ i.e. we show that g£S',gE L]^^ {«^\S), J w |f {gpl^ < oo and Cd = Cgp 
on S. 

Since G E S' and ipES,g = G*ipES' and g ^ ^G, as distributions. Further, from Definition SH 



of the basis distribution G wc know that 
V' G '5'0,2e- But property W2.1 implies — - 



I G (K'*\0) which means that gp — 
by definition p E Sg^g so that Theorem 1151 implies \lp\^ = ipp E 50.29 and 



on R'^\0. But 



I i2e I |2 



,28 m 



,40 



w 



,20 



< oo. 



(4.28) 



To show — ^"gF on S, we need to show that ^"tpG 



on S. But by Theorem[l5l C e C'fl^e n 



C^P and hence ^"(^ e ■^'g 29 f^nd hence for ip E S the basis distribution definition implies S^'^tpG, ip 
G,(,°''(fip — J "^at 1 as required. This means that l4.2Sl is true and so proves [¥.261 
Now to prove formula [4. 2 71 From above we know that fp — f on M'^\0 then 



wlf'fp- 



,20 



where (p* (x) — p i^x) and 0* E Sijj g. From part 4 of Summarv lllll fp G 5*0 ^ and f — fp on 5*0 9, so 
that 



as required. 



4-5.2 The Light norm for 

Using the results of the previous section, a unisolvent set of points will be used to create an inner product 
space from the semi-inner product space X^ introduced above in Definition [5T] This particular inner 
product was introduced by Light and Wayne in [llj and involves evaluating functions in X^ on the 
unisolvent set, which is OK since X^ C Cjlpj^ by part 5 of Summary Ell 

Definition 115 Suppose > I and suppose the set A — {oi} is minimally unisolvent with respect to 
the polynomial space Pg. Then following Light and Wayne 111] we will introduce the following norm and 
inner product for the space X^ : 

i i 

where \u\^ g is defined by \4.56\ \\-\\^ g is actually a norm since \\-\\^ g — ^ implies that \u\,^ g — ^ 'J^'^ 
u(ai) = for all unisolvent a;. By part 3 of Summarv lllll \u\^ = ^ means u E P0 and so from the 
definition of unisolvent sets u — Q. 

Theorem 116 Properties of the Light norm. 

Suppose the Light norm and the Lagrangian interpolation operator V are defined using the same min- 
imal unisolvent set {oi}. Then: 

1. {Qu,v)^g = {u,Qv)^g = {u,v)^g. 



4.5 Riesz representers for the functionals u D''u (x) 
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2. {Vu,v)^,g = {u,Vv)^g ^Y.u{ai)v{a^). 

Proof. Define the Light norm using the minimal unisolvent set A = {ai}. Then using results from 
Theorem 11021 concerning the operators V and Q: 

Part 1 {Qu,v)^g = {Qu,v)^g + Y,Qu{a.i)v{a,) = {Qu,v)^g, since Qu{ai) = 0. But {Qu,v)^^g = 

i 

{u-Vu,v)^ g = {u,v)^ fj and so {Qu,v)^ g = {u,v)^ g. Similarly (u, Q v)^^g = {u,v)^^g. 
Part 2 {Vu, v)^ g = {Vu, v),^ g + E ^ = E = 

= ^u {ai) V (ai), since Vu interpolates {a^, u (ci)}. Similarly {u, Vv)^ e ~ S " ("^i) ^ ('^i)- ■ 



^^.5.5" Derivation of the Riesz representers D^Rx 

In this subsection we derive simple explicit formulas for the Riesz representers for the evaluation func- 
tionals where D'^u € and I7I < [kJ . These formulas are exhibited in equation l4. 351 below and involve 
order 7 derivatives of the basis function and the cardinal basis functions associated with the Light norm. 

Suppose that the weight function w has properties W2 and W3 for order 6 and parameter k. Then 
by Summary lllll the functions in have order [kJ differentiability. We endow the space X^ with 
the Light norm generated by a minimal unisolvent set A = {cii}^^^ and its corresponding cardinal basis 
of Pg. We will also make good use of the Lagrangian interpolation operator V and the operator 
Q = I -V introduced in Section EXT] 

The approach used here is to first assume the Riesz representers exist, and then to derive the form of 
the representer by substituting for u two classes of functions. First we use the cardinal basis functions 
associated with the unisolvent set used to define the Light norm and then the functions in G * S'a.g 
discussed in Subsection 14.5.11 By this means we obtain the form of the representers. Once we have the 
candidates for Riesz representers it will be shown that they have the properties initially assumed. 

We start by assuming that for all x e there exists € X^ such that {u, Rx)^ e ~ "^i^) ^'-'^ 
u £ X^. Now if e R'' then u{x + h) ~u{x) = (u, Rx+h)^^g - Rx)^^g = Rx+h ~ Rx)yjfi and so 
we would expect the formula D^u {x) = ( w, ) to hold, and indeed we would expect the formulas 

V ^ J w,9 

D^u{x)^{u,D2Rx)^^g, |7|<W, (4.30) 

to hold. Next observe that we have the anti-symmetric result 

Rx {y) = {Rx, Rv)^^g = [Rv,Rx).^^g = IW)- (4-31) 

By definition the cardinal basis of Pg has real- valued coefficients and satisfies U — {aj)Sij. 

Thus 

M 

Ij (x) = {lj,Rx)^^g = {lj,Rx)^^g + Ij {ai) Rx {ai) = Rx (flj) = Rx {aj) , 

i=l 

so that 

lj{x)^Rx{aj). (4.32) 

Next we will substitute functions from the space G * Sijj g = |g * </i : g 'S'0,6(| introduced in Section 
I4XT] Thus, if e 50,e then by Corollary [m] G * (j) e X^ and so 

(G*^) {x) = {G*cP,Rx)^^g = {Rx, G * cj,)^ g 

M 

= {Rx, G * 4>)^g + Y.Rx (aO (G * cj)) (a,) 
1=1 

M 

= {Rx,G* cj))^ g + Y,h (x) (G*0) (a,) 
1=1 

AI 

= [Rx,^ +Y,h{x)W^W(^, 

1=1 
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where the last hne was derived using equation 14.271 Rearrange this equation to get 



M 



[R,, 0] = (G * 0) (x) (^) (G * </>) {a^). 



But 



(G * </)) {x) ^{G*<t>) {^) = (2vr)-' [G (x - •) = (2^)"^ [G [x - ■),cj, 



so 



or 



A'/ 



[R^,^={2TT)-i [G(--x),'^-{2Trr--Y^k{x) [G(--a,),^ , 
[i?,,^] - (27r) 



Af 



i=l 

for all </) e ^B^g. But by part 1 of Theorem [T71 u e P„ iff [u, 0] = for all G S'g^n. Hence 

M 

(2^)^ i?, e G (• - - ^ {x) G (• - a,) + Fe, 

i=l 

SO that for each x, € Pg and 

(2^)^ i?^ = G (• - x) - ^ I, (x) G (• - a,) + 9,. 



(4.33) 



We now calculate qx by applying the operator V to 14.331 This involves using the result VRx — 



M 



Ij (x) Ij and assuming that qx ^ Pe, so that Vqx — qx- In this way we obtain 



M 



M 



qx=Y.k{x)VG{--ai)-VG{- 



4=1 



(4.34) 



so that 



M 



M 



{2nyRx{y) = G (y - x) - ^ (a;) G (y - a,) - ^ G (a, - x) (y) + 



(4.35) 



Af 



+ ^ (x) G (a, - a,) (y) + (27r)^ ^ (x) I, (y) . 

This equation will be used to define Rx (y) and noting I4.30[ DJRx will be our candidate for Riesz 
representer for the evaluation functional D'^u {x) when I7I < 

Theorem 117 Suppose G is a basis function of order 6 generated by a weight function with properties 
W2 and W3. Suppose the operator V is defined with the same minimal unisolvent set used to define Rx 
in\J^ Then 

M 

Rx (y) = {2TT)-i QyQxG (y ~ x) + ^ I, {x) I, (y) , (4.36) 

where Q — I — V . 

Proof. The basis function is continuous by Theorems HHl or [501 Expanding Qx and then Qy yields 
equation 14.351 for Rx- ■ 

Theorem 118 QyQx [y + x)" = when \a\ < 20. 
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Proof. QyQAy + ^r = QyQ. E Ov^ i-^)"'" = E O (QyV'') and since \a\ = |/3| + 

/3<Q /3<a 

\a- (3\< 29 it follows that < 6* or |a - /3| < 6* and hence that (Qy/) (Qa^a;""'^) = for all (3 < a. m 
Theorem 119 For each x, as a function: 

1. Rx is independent of the basis function used to define it. 

2. Rx is independent of the order of A. 

Proof. Part 1 From Definition lU of a basis function, any two basis functions differ by a polynomial of 
order of at most 29. Our result now follows easily from Theorem 1 11 71 and Thcorcm lllSI 

Part 2 To prove this part we use equation 14.361 for Rx (y) . From Theorem 11021 the function Q is 

_ d 

independent of the order of the unisolvent set which generates it. Thus (27r) ^ QyQxG {y — x) is also 

M 

independent of the order of the unisolvent set which generates it. Further, ^ lj{x)lj (y) is independent 

of the order of the cardinal basis functions. Hence Rx is independent of the order of A. ■ 

Theorem 120 Suppose the weight function w has properties W2 and W3 for order and parameter k. 
Suppose the distribution Rx € S' is defined by equation \4. 3 5\ Then for \ j\ < [kJ we have DJRx € 
and 

' ^ ^' . ^eR^ (4.37) 

w\-\ 

where \4-14\ provides an upper bound for the right side of \4.37\ 

Proof. We prove that D^Rx e by using definition KT^ i.e. we show that D2Rx e 5", DjRx S 
Ll^ (K''\0), / w \{D2Rx)p\'^ < oo and that |a| = 9 implies CofKc = C {D7xRx)f on S. If these 
criteria are satisfied then \D'].Rx^w o ~ I ^ H^^ \{Dx^x)f\'^ ■ 
From [133 for each xGR'^ 

M 



{2nf'^DlRx = e-'("'-)5^-^i^'^/,(x)e-^<'^-->G + (f, 

i=l 

M 

= G-Y, D^k (x) e-'<'^-->G + Qx 

i=l 

= {-liV - D-'U (x) e-'^---^^ G + q. 

= DZ |^e-'(^') -YJ, ix) e-^^^"-^^ G + q. 

= [D2Qx{e-'^''--^))G + qx. (4.38) 

where Qx & Pe- Since W2 implies 1/w G Lj^^, Definition of a basis distribution implies G = ^^^20 € 
^oc (IR''\0) and so [1351 implies that for each x 

{DIRx)f = (2^)-* I' e (k'\0) . (4.39) 

w\-\ 

Again bv lOSl and Theorem fTTUl 

/ w \-r\{D1Rx)F\' = [2.]-' I l"'-^^^;.!'"'^'' < 00, (4.40) 
J J w\-\ 

Now use ^ as an action variable. It must be shown that if^DjRx — ^" {D2Rx)p on S when \a\ = 
9, which is true if C^x = C {Rx)f on S when |a| = 9. But from lOSl it follows that CRx = 
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CQx (e-*("='«)) G + Cqx = CQx (e-'("='«)) G since e Pg. From part 4 of Theorem [Ml if \a\ = 6 
then for each x, 

{i£,T Qx (e*(^'«^) e C^20 ri Cfp and so V G 5 impUes (^0" Qx (e*(^'«)) Tp e S'0.2e by TheoremlHl Thus 
by the definition of a basis distribution 



CRx,^] - [CQx (e-^(^'«)) G,^] = [g^CQx (e-'(^'«)) ^ 



C {Rx)p^, 



and hence — {Rx)p on S*. We can now conclude that DJRx G X^, that 14.4(71 is true and so 

14.371 is proven. ■ 

Corollary 121 Suppose the weight function w has properties W2 and W3 for order 9 and smoothness 
parameter k. Then for \5\ , I7I < [kJ we have 



{DlRy,D2R^)^^^{2n) 



W 



,20 



Proof. Write {DlRy , DIR,^) ^ 1^ M {D^Ry) p {DlR^)p and then use|13ni ■ 

Now we prove the important result that when I7I < k, DJR^ is the Riesz representer for the evaluation 
functional u — s- D'^u (x). 

Theorem 122 If u e Xf^ and \ j\ < k then 

D'^u{x) = {u,DlR,)^,, x(,m.\ 

where R^ and the Light norm \4^2^ are defined using the same minimal 6-unisolvent set A = {afcj^L^- 

Proof. Suppose Rx and the Light norm are defined using the minimal unisolvent set A = {ifelfeLi and 
that the corresponding cardinal basis {^fc}fcLi of Pg. From the definition of the Light norm 

» M 
{u,DlRx)^^e^ / w If up{DlRx)p + ^ u (ofc) [DlR,) (flfe), 

k=i 

where the function {Df.Rx)p is given by 14.391 Hence 



w\-fup {D2Rx)p = {2tt) 



' w\-\ up = (27r) 



and byESa D'<lk {x) = {DJRx) (ofe) so that 



M 



M 



J2 u (flfe) (DlRx) (flfe) = J2^ D^lk (x) = (D-'Vu) (x) . 



k=l 



k=l 



Thus 



and comparison with equation 14.231 of Theorem 11131 for D''u implies D^u{x) — {u, DJRx)^ g as 
required. ■ 

Showing that X^^ is a reproducing kernel Hilbert space now becomes very simple. 

Corollary 123 Suppose the weight function w has properties W2 and W3 for order 6 and parameter k. 
Then X^ is a reproducing kernel Hilbert space when endowed with the Light norm. 



< 



Proof. By Theorem [MH i?^ e X^. Hence by Theorem [T^ with 7 = we have \u {x)\ < {u^R^).^ 

\\Rx\\^ g g and g is a finite constant for each x. Hence X^ is a reproducing kernel Hilbert 

space e.g. Theorem HL9.1, Yosida ■ 
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Theorem 124 Properties of DJRx 

Suppose the weight function w satisfies properties W2 and W3 for order 6 and k. Suppose Rx is defined 
using the minimal unisolvent set A = {aj}^^^. Then for all x,y & M.'^ and \ j\ < \_k\ : 

1. Rx {y)^Ry{x). 

2. For j — 1, . . . ,M, (D^Rx) (oj) = D'^lj (x), and each cardinal basis polynomial Ij has real coeffi- 
cients. 

3. D''Qu{x)^{u,DJRx)^^g,ueXi. 

M 

I VDJRx = E (x) Ij = D^VRx and QDJRx = DJQRx- 

5. The Riesz representer is unique. 

Proof. Parts 1 and 2 By Theorem 11221 DJRx is the Riesz representer of the evaluation functional 
u — > D'^u (x) and so equations 14.311 and 14.321 are valid. By Definition llOOl the cardinal basis polynomials 
have real coefficients. 

Part SlfueXl then by part 1 of Theorem [HS] I?'^ Qw (x) = {Qu,D1Rx)^ g = {u,D2Rx)^ g. 
Part 4 Using part 2 

MM M 

j=l j=l j=l 

so that 

QD2Rx = DlRx - VDlRx = D^Rx - D^VRx = D^QRx- 

Part 5 Suppose two representers exist, say D].Rx and sjc'''. Then for all u G and x G M'', 
{u, D^Rx)^ e = in, s'^'A = D^u (x) and hence 

f u, S'i'^ - DJRx) = which iniphes S^^^ = D2Rx- ■ 
4.5.4 The semi-Riesz representer = QRx 

Here we will introduce what I will call the semi-Riesz representer rx — QRx for the evaluation functional 
u ^ u (x). This terminology is based on the equation Qu (x) — {u^rx)^ & derived in part 7 of 
the next theorem. A bound for the the function rx [x) will be obtained in Subsection 14.10.21 which will 
then be used to estimate the pointwise rate of convergence of the interpolant. 

Theorem 125 Suppose the function rx = QRx "is defined using the minimal unisolvent set {ak}^^i and 
corresponding cardinal basis {lk}k^^i of Pg. Then rx has the properties: 

M 

1. rx (y) = Rx (y) - E (y)- 

2. rx (y) = ry (x). 

3. rx (oi) = rai {x) — for all i. 

4. Vrx = and Qrx = rx. 
5- rx (y) = {rx,ry)^ g. 

6. rx{y) = {2^yi QyQxG[y-x). 

7. Qu [x) = (w, rx)^^g when u e X^. 
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Proof. Part 1 Apply Qy to equation 14.361 Part 2 Follows from part 1 since (y) ~ Ry [x) and the 
Ik are real valued. Part 3 Part 2 of Theorem 11241 with 7 = implies Rx (ai) = U [x). Parts 1 and 
2 now give this result. Part 4 Use part 3. Part 5 Part 3 of Theorem 11241 with u = and 7 = 
gives Qr^iu) = {rx,Ry)^ g. Since Qr^ = r^, Theorem [nl implies (y) = Qrx (y) = {rx,Ry)^^g = 
{rx,QRy)^g = {rx,ry)^g. 

Part 6 Apply Qy to formula [4.361 Part 7 follows from part 3 of Theorem 11241 with 7 = 0, and then 
use part 4. ■ 

Remark 126 The projection properties of the operators V and Q can be used to show that = 
Q {X^^ © Po and that Q {X^^ is a Hilhert space when endowed with the semi-inner product (•, ■) ^ g. In 
fact, on Q (A^^), rx is the Riesz representer of the functional f ^ f (x) and Q (A^) is a reproducing 
kernel Hilhert space. 

4.6 The basis function and reproducing kernel matrices 

In this section we will introduce the basis function matrix and the reproducing kernel matrix. Together 
with the unisolvency matrices these matrices will be used to construct matrix equations for the basis 
function interpolants of this document. 

4-6.1 The basis function matrix Gx,x 

The ba.sis function matrix and the unisolvency matrix will be used to construct the block matrix equation 
14.661 for the variational interpolation in Subsection 14.9.41 

Definition 127 The basis function matrix 

Let X = {x^"^} be N distinct points in R'' and suppose G is a (continuous) basis function. 
Then the N x N ba.sis function matrix Gx.x is defined by 



4-6.2 The reproducing kernel matrix Rx,x 

The reproducing kernel matrix is derived from the Riesz representer of the evaluation functional u ^ u {x) 
discussed in Section 14.5.31 I call it the reproducing kernel matrix because the existence of this special 
evaluation functional means that the space Xf^ is a reproducing kernel Hilbert space when endowed with 
the Light norm. This matrix is closely linked to the basis function matrix of the previous subsection will 
be used to construct a matrix equation for the variational interpolation problems of Section 14.91 In the 
next chapter we will study the relationships between the reproducing kernel matrix and the basis function 
matrix and derive a matrix equation for the Exact smoother using the reproducing kernel matrix. 

Definition 128 The reproducing kernel matrix Rx,x 

Suppose a basis function has order 9 and suppose that Rx{y) is the Riesz representer of the evaluation 
functional u u{x), u G A^ defined by \4.35\ Also suppose that X = {a;("^}„_ is a set of distinct 
unisolvent data points in M."^ . Then define the N x N matrix Rx,x by 



Theorem 129 Suppose the conditions imposed in the definition of the reproducing kernel matrix Rx.x 
hold. Then the following are true: 

1- Rx,x — {{RxUU Rx^'>)w.0) so it is a Gram matrix i.e. has inner product elements {ui,Uj)^ g. 

2. The matrix Rx.x is Hermitian, regular and positive definite. 

3. The functions {Rx(i)}f^i are linearly independent. 

Proof. Part 1 By definition of Rx, Rx,x — (RxU) (2;^'^)) = (RxU) , Rx(i) )w e- 
Part 2 These are elementary properties of a Gram matrix. 
Part 3 This is a direct consequence of the regularity of Rx,x- ■ 
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4.7 The basis function spaces Wc,x and Wg,x 

The importance of the finite dimensional spaces Wg.x and Wg,x is that they will contain the basis 
function interpolants of this document and the basis function smoothers of the succeeding documents. 
Here X is the independent data and will be assumed to be unisolvent. The finite dimensionality of these 
spaces means that matrix equations can be constructed for the interpolant and the smoothers. 

Definition 130 The basis function spaces Wg,x and Wg,x 

Suppose the weight function w has properties W2 and W3 for order 9 and smoothness parameter 
K. Then the basis distributions of order 9 are continuous functions and let G be a basis function. Let 
X = |a;(*)}^ be a 9-unisolvent set of distinct points in and set M = dimPg. Next choose a (real) 
basis {pj}^j^^i of Pe and calculate the unisolvency matrix Px ~ {pj (a;'*')). We can now define 

Wg,x = 1^ - -.v^eC and P^v = o| , (4.41) 

Wg,x = WG,x+Pe- 

Clearly Wg.x and Wg.x are vector spaces. When convenient, functions in spaces of the form Wg,x 

N 

will be written, fy (x) = ^ vtG (a; — x^'^) . 

In words, Wg,x is a subspace of the complex span of the X— translated basis functions and Wg.x 
is a subspace of the complex span of the X —translated basis functions plus the polynomials of at most 
basis function order. Sometimes we will say data-translated basis functions. 

The next theorem shows that the set Wg,x is independent of the order of the points in X and of the 
basis of Pg used to calculate Px- 

Theorem 131 Let {pi} and {qi} be two bases for the polynomials Pg, and set Px = {pj (a;*-*-*)) and 
Qx - {qj (a;(*))). Then 

|^z;,G(a;-x«) : P^i; = o| = |^ (a; - x«) : g^A* = o| , (4.42) 

and Wg.x is independent of the basis for Pg used to define Px ■ 

Proof. From part 3 of Theorem 11041 there exists a regular matrix R such that Px = QxR^ ■ Hence 
= PQ3f and then equation 14.421 easily follows. ■ 
Now recall Definition llOOl regarding permutation theory. 

Tiieorem 132 As a set W g,x is independent of the ordering of X and independent of the basis function 
G used to define it. 

Proof. Using the notation Gx,x ~ {x ~ a;*^^-*)) we have 

Wg,x = |^«,G(a;-a;«) : Pjt; = o| = [G^^xv ■ P^v ^ Q] , 



where Pj = (k (a;^^))) 



/ pi(a;«) pi(a;(2)) ... pi (a:W) \ 



\pm{x^'^) PM(a:(2)) ... ) 
Suppose re-ordering X uses the permutation tt. Then re-ordering a row vector involves right multipli- 
cation by the permutation matrix li^ so that Gx,-k{x) — Gx,x^^ ^ ^lix) ^ ^x^^ ^^"^ hence 



Wg,7,(x) 



{Gx^x) ■■ P^ixf = O} = {Gx^^^x)^^v : Pln^v = 0} = Wg,x. 
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Set-wise independence of the basis function will hold if p (z Pe implies 

'^f^iVip{x — x^^^'j — and clearly we need only show this for the basis functions Since 
{^"}\a\<e is a basis, by Theorem [I3I]Pjt> = iff J2f=i (a;('))" = for |a| < 9. Thus 



i=l i=l a<a ^' I3<a ^' i=l 



a-(3 



0, 



j=l I3<a 

confirming set-wise independence. ■ 

Lemma 133 Suppose X — {xk}'^^^ is 6-unisolvent and Px is a unisolvency matrix of order 6 (see 
DeUnition MOS]) . Further, suppose v = {vk) € satisfies PxV = 0. Now define the function Uy '.Mf^ ^ C 
by 

N 



k=l 



Then the function has the following properties: 



1. (z C^g n 



2. If (p ^ S then |a„| cj) ^ S and 



N 



if 1^ 'f>= ^ VjVkCf) (• - {Xk - Xj)) . 
3,k=l 



3. (z) = a.e. implies Vk — for all k. 
Proof. Part 1 Since 



(4.43) 



N 



N 



p-*(a:fc,z) 



k=l 



k=l 



it is clear that all derivatives are bounded and hence Uy E C^. If |/3| < then 



N 



N 



D^ay (0) = J2vk i-ixkf = i-if^ E = 0, 



fc=i 



k=l 



since P^v = 0. 
Part 2 





AT 


2 




ay {x)\^ <j> (x) = 

















N 



,k=l 



N 

: VjVke- 



Therefore 



^ r _ _ 1^ ^ ^ 

%y\^(j>(ij)= VjVk e-'^''^-'"'^''U{x) {v)= VjVk<l){xj - Xk + T]) 

j,k—l j.k—1 

N 

= ■"j^k'(i>{r]-{xk-Xj)). 

j:k = l 
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Part 3 Let A = {xk ~ xj : 1 < j, k < N, j}. Then ^ A and so 6 = dist (0; A) > 0. Next let iv^ 
be the standard 'cap-shaped' distribution test function 



0, \^\>e, 



with Ce chosen so that (0) = 1. Now uj^ has support i?(0;e) and if we set — W5 (C) it 

follows that (/) (0) — 1 and 0(0 =0 when ^ e A. Thus — Q a.e. implies |a„|^(/) — a.e. and so, 

N ^ N 

= ^ VjVk<j} ~ {xk — Xj)) = J2 ^^'^ therefore Vk = for all k. ■ 

j,k=l k=l 

Next we obtain expressions for the semi- inner product and seminorm of functions in Wg,x- 

Theorem 134 Suppose w is a weight function with properties W2.1 and W3 for some order 9 > 1. 
Suppose V = (vi)^^^ is a complex vector satisfying = where Px is the unisolvency matrix. Then 
we have the following results: 

1. If the functions fy and are defined by 

N N 

/„(x) = ^z;fcG(a;-xW) e VFg.jc, a. = ^ (4.44) 

fc=l 3 = 1 

then fy E and 

„ I ,2 N 

\Ml.e = / ^ = (2^)^ E ^^^G (x^-'") - xW) = (27r)^ v''Gx,xv. (4.45) 

2. Each f e Wg.x has a unique representation \l.4-l\ and dmiWcx — N ~ M . 

3. Gx.x is conditionally positive definite on nuUP^ i.e. PxV = and v ^ implies v'^Gx.xv > 0. 

4. We have the direct .sum Wg,x = Wg,x ffi Pe cind dmiWG,x = N. 

5. Xl = Wg,x ® W^x w/jere 

Wg,x = {u(^Xl:u (x^*^)) = for all x^''^ E x} . 

Proof. Part 1 The first step is to show that /„ S X^ . Here we use the definition of X^ given in equation 
EUlli.e. fy e S', I e Ll^ (M''\0), / w \-f \{fy)p\^ < 00 and |a| = 9 implies Cl = C {fv)p on S. 
Clearly since G G S" we have /„ G S' and 

N N / N 

/. = E -^P^ [g - -^'^)] - E «.e-<^<^"''«)G = -.--^(^"''^^ ]G = ay (C) G, 
where Oy is given by 14.441 

Thus U = on R'^\0 and since property W2.1 is l/w e L]^^ it follows that e L]^^ and 

(^)f = (4.46) 
w\-\ 

By Theorem [1331 a„ G G^g n Gf and so by Theorem [H] we have |a„|^ € C^^g n Gf . Further 







2 




Oy 




jw\-f 













(4.47) 



I i2e 
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From Theorem [TUl W3T implies property W3.2 and by definition property W3.2 implies /, 



< 



'M>r-3 w\-\ 

oo for some > 0. Choose cj) G such that < < 1 and (x) = 1 in a neighborhood of 0, and 
define (f>^ by: (j)^ {£_) = (e^) for e > 0. Then 



(4.48) 











J w\-f' J 









and since (p^ \ay\^ G 5*0 2 e we have by the basis function Definition 1441 that J 



G, 0g |a„|' 



< 



00. Further, for sufficiently small e the support of (1 — (j)^) |a„| lies outside the sphere of radius so 
property W3.2 now ensures that the integral HUH] exists. To finish the proof that fy E we must show 
that C {U)f = Cl on S i.e. Ca.G on S. 

If \a\ = e then by Theorem[15l C G C^g. C^v € C^2e ^ '^bp and Co-vip e 50,29 when iP G S so that 

1 



w 



,20 



,26 



We have already shown that |at,|^ € C'0°2e ^b' |a„|^(/)g £ 50, 20 and by definition of a basis 



as required. Thus /„ € and 14.47] proves the first equation of 14.451 
We have 
distribution 

1 



J w\- 



2e^e 



,28 



G,\ay\ (f)^ 



N 



by part 2 of Theorem 11331 By the convolution definition of part 2 Appendix 12451 



N r ^ 



(fc) _ x^'j) 



^ 1 — 1 V / 



j,k=l 



V V d 

Now in the tempered distribution sense as e ^ 0, 0^ ^ 1 and so 0^ ^ 1 = (27r) ^ 5 and hence 

V d _ _ 

G * (f>^ G * (27r)2 (5 = G pointwise because by Theorem H9l and [501 if w has properties W2.1 and W3 

V 

then G G G^"-*. Here 0^ is called a mollifier e.g. Lemma 2.18 Adams j2j. Thus 



lim 

e->0 



W 



,26 ^£ 



(2^)^ J2 VjV]:g(^ 



I 1^ 

and finally we note that lim f ,"L 



N 



Part 2 Suppose '"kG {x - x^''^) = for all x and P^v = 0. Then 



fc=i 







k=i w^l 



26 ■ 



Since w > a.e. we must conclude that — a.e. and that by part 3 of Lemma 11331 Vk — for all 
k. Thus the operator $ : nuUPj — > Wg,x defined by — X^fcLi ^kG (• — x^*^^) is an isomorphism and 



so dim VFg,x = dim null = - M by part 5 Theorem ITOl 
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Part 3 From part 1, P^v — implies v^Gx,xv > 0. Suppose v^Gx,xv — and P^v — 0. By part 1 
of this theorem 

N 



— V Gx.xv — 



k=l 



JV 



so that ^ VkG (x — x'^'^^) = 0. Part 2 of this theorem then imphes v = 0. 

k=l 

N 

Part 4 We must show that Wg,x n Pe ^ {0}. Suppose p S Wg.x H Pq. Then p = J2 ""kG {x - x^'^)) 

fc=i 

and PxV — but by part 1, = \\p\\^ g = (Stt)"^ v^Gx,xV- Part 2 now imphes w = and hence that 
p = 0. 

Part 5 Since is a basis for W^g^x 

W^G,x = [v e Xi I {v,u)^ g = Oifue Wg.x} = {v e \ {v,R,,.,)^ g = if x^^^ e x] 

■ 

A consequence of the last theorem is the following representation result for members of the set Wg,x- 

Corollary 135 Suppose the definitions and assumptions of Theorem \134\ hold. If {Pj}^^i is basis for 
Pg then the representation 

{N M 
a,G (■ ~ a;(*)) + ^ (3jPj : P^a = 0, a = (a,) , a,, /3j G 

is unique in terms of ai and . 



Proof. This follows directly from parts 2 and 4 of Theorem 11341 ■ 

In Subsection 14.9.41 a matrix equation will be derived for the coefficients ai and (3.-j . From Theorem 

ITflwe know that the data-translated basis functions {G (• — x^^^)^^_-^ are linearly independent and from 

the last theorem we know that the dimension of Wg,x is N — M . However no subset of the functions 

{G (• — x'*)) containing iV — A/ of these functions spans W^g,x- The functions |G (• — x'*)) j^^^ can 

be called basis functions w.r.t. Wg.x in the sense that linear combinations of these functions can be 

used to construct a basis for Wg.x- In fact, in the next corollary we will show that provided the minimal 
unisolvent subset A used to construct the Riesz representer Rj; lies in X and constitutes the first M 

points of X, it will follow that {Rx(i)}iLM+i ^ basis for Wg.x- 

Theorem 136 Suppose w is a weight function with properties W2 and W3 for order 9. Next let X = 
{x''')}^ be 6 -unisolvent and suppose is a minimal unisolvent set. Define the Riesz 

representer function Rx by \4.32\ using Xi . 

Then the spaces Wg.x o,nd Wg.x have the following properties: 
1- Wg.x has basis {RxM}iLi over the complex numbers. 
^- WG.xhas basis {Rx(i'i}iLM+i over the complex numbers. 

N ^ 

Proof. It will first be shown that if /3 = {/5fc}fc=M+i complex numbers then ^ fSf^RxW G 

k=M+l 

N 

Wg.x- Let gp — Pk^^xC')- Then each Rx(k) € X^ and from equation 14.391 

k=M+l 

= ,2,)-" (84^-'-')) (^-^"') „ 

w \-\ 
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Thus 



N 



{9/3) F = X! Pk{Rx^''))F 
N 

k=M+l 

N I M 

E /3. U-'(-)-^Z,(x)e-<^"'^-)] (.. = .W) 

N I M 

E /3. h-^^^'"-)-E^. M 

\ i=i 

N M / N 

E /3.e-<^'"-)-E E 



k=M+l 


(OttY 
(ZTT) 


-d/2 






w \- 


|2fl 




— a/ A 






w \- 






-d/2 






w \- 


|2e 




-d/2 


w • 


|2e 



fe=A/+l i=l \fc=M+l 



AT 

From [4461 and l444l we see that if A = E 7fcG (• - x^''^) then 

fc=i 

(/.)^ = i^J^E^fce-^^'"'-) and setting (g^)^ ^ (M^ g ^^e'^^''''^-) yields 



N 

7, = < fcM+i ^ ^^J' (4.49) 



(2^)''/2/3„ j>M. 



The criterion of part 1 of Theorem [TUS] clearly implies that Pxl = and thus 

N 

= {27r)-''/^ E - e Wg.x and (g^ - /^)^ = 0. But by part 4 Summaryimi gfj-f^e 

i=i 

^ ^ N 

Pg and thus g/3 G Wg,x- Further, 5^ = Pk^xW so Pk^xW € Wg,x and span{i?^(j)} - C 

fc=A/+i fc=i 

To prove the converse choose u G Wg,x- Then u = /^jG (• - a;^^)) + q for some q ^ Pg and /3 G C 
such that i^x/^ = 0. When 7 = and x — x^^^ equation 14.331 for can be rearranged to give 



M 



where each q^u) G Pg. Hence, since 14.341 implies q^u) = {2tt)^ Rxd) fo^' J 

JV . W Af M .AT 



5]/3,g(.-x(^)) = (2^)*5]/?,i?,(„+5]/3,-5]/,(x(^))G(.-x«)-^/3,g, 

JV M / N \ 

= (2.)^ ^ /3^.i?^,,+^K^/3^./,(,0)) G Pol^ 



j=A/+l i=l \ j = l / j=A/+l 
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and so 

N 



N M / N \ AT 

= (27r)^ + E E PM^^'^) G (• - a:^*^) - Pjl-^^^ + 9 

Af M / N \ N 

= (27r)^ Y f3,R.u) + E + E G (• ~ x^*)) - ^ + q 

j=M+i i=i y j=M+i y j=Af+i 

= (27r)^ ^ f3jR^u)- Y (^](lxU)+q, 

j=M+l j=M+l 

N 

since by part 1 Theorem [1051 = iff /3, = - (a;*^') for each Thus Wa.x = 

3=M+1 

spa,n{R^(j)}f^^. Further, by part 2 of Theorem 11241 we know that R^U) = Ij for 1 < j < M and 

c 

so span = Pg. Therefore the result Wax — Wax ® Pe from Theorem 11341 impUes that 

c ■' 

Wg.x ^ span {R^u)}f^j^,j_^^. m 

c 

The previous theorem assumed that the Riesz representers were constructed from a minimal unisolvent 
subset Xi of X which consisted of the first AI points of X. The next corollary weakens this assumption by 
that we can choose any minimal unisolvent subset of X . Now recall Definition 1 1001 regarding permutation 
theory. 

Corollary 137 Suppose w is a weight function with properties W2 and W3 for order 9. Next let X = 
{^'''''Ifc-i -unisolvent and suppose A G X is any minimal unisolvent subset. Denote its cardinal basis 

by {lk}kLi '^^^ define the Riesz repres enter function R^ by \4-.S5\ Then the spaces Wg,x CLnd Wg.x have 
the following properties: 

1- Wg,x has basis {Rx(i)}iLi o'^^^'' the complex numbers. 

2. Wg,x has basis {^R^ti) '■ x^^^ ^ A} over the complex numbers. 

Proof. Part 1 We want to use Theorem 11361 so start by re-ordering X using a permutation tt such 
that the first M points in ttX belong to A. By Theorem 11361 Wg.ttX has basis {Ry(i) (7rA)}^_^ where 
— 2;(7r(«)) Bv l4.35l the function R^ only depends on G, A and x and by Theorem lll9l Rx is independent 
of the order of A. Hence Wg,7tX has bases {RyM (tt^)} = {RyM {A)]._^ = {Rxi.i)}iLi- By Theorem 
11321 the set Wg,x is independent of the order of the points in X. Hence Wg,7tX — Wg,x and we have 
part 1. 

Part 2 We know from part 4 Theorem 11341 that Wg.x — Wg,x ® Pe, and from part 2 Theorem 
11241 we know that {^Rx^i) '■ a;^*-* £ A} is the cardinal basis for Pg generated by A. Thus T4^G,xhas basis 



4.8 The vector- valued evaluation operator Sx 

The vector-valued evaluation operator £x and its adjoint will be fundamental to the study of the inter- 
polant in this document and to the smoothers in the later chapters. This function evaluates a function 
on an ordered set of points to form a complex vector. 

Definition 138 The vector-valued evaluation operator £x 
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Let X — {^x^^^^^_^ he a set of N distinct points in . Let u be a continuous function. Then the 
evaluation operator £x is defined by 

Sometimes we will use the more compact notation ux for £xu and when dealing with matrices £xu 
will be regarded as a column vector. 

We will now assume that the weight function w satisfies properties W2 and W3 for order 9 and k. 
Then the functions in are continuous. The Riesz representer of the evaluation functional / f{z) 
allows some important properties of the evaluation operator £x to be proved. In the next theorem we 
assume that the first M points in X are minimally unisolvcnt and use these to generate Rx- 

Theorem 139 Suppose that X — {x*-*-*} . is a 9-unisolvent set of distinct points in M''. Assume that 

A = {ai}f^^ is any minimal unisolvcnt subset with cardinal basis {^fcjfcLi which we use to define the 
Riesz representer Rx, the Light norm ||-||^ ^ and the Lagrangian interpolation operator V . Then: 



L The evaluation operator £x ■ ^^^JI'll^ 
W^x- 

2. The adjoint operator £x ■ X^, defined by ( £xf, P 

i=l 

and £'^ is continuous, 1-1 and maps (C^,|-|) onto {Wg,Xt\\'\\w 



(C^,|-|) is continuous and onto. Also, mi\\£x = 



(f,£xP) , satisfies 



N 



(4.50) 



£^ = £x = \\Rx,x\\, where Rx,x — {RxuA^^^^)) '■^ (regular) reproducing kernel matrix 
discussed in Subsection \4.6.3\ and \\-\\ is the matrix norm corresponding to the Euclidean vector 
norm. 

4. Assuming (3 is a column vector and £x is a column vector we have 

£x£*xP = Rx,xl3, 13 e C^. 

5. Assuming that £x and 7 are column vectors, 

£x£*Ai = Lxi, 7 e C^^ 

where Lx — {ij i^^^"^)) is the N x M cardinal unisolvcnt matrix ( Definition 1 1 corresponding to 
the minimal unisolvcnt set A. 

6. £*x£x ■ Xf^ — > Wg,x is onto and n\il\£^£x = x- ^^^^^ /^^^ ^ ^ 



N 

(i*x£xuj (x) = (^^'O ^^''^ 



N 

U, ^ Rxd) (x) Rxif) 



7. For a € C^, (vr^aj (x) = (a'^Lx) I (x) where I (x) = {k {x)). 

8. ixVf = Lx£Af- 

Proof. Parts 1 and 2 We will first show that £x is continuous. In fact 



£xu 



N 



N 



N 



N 



(*> Ww.e 
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SO that Ex '■ — > is continuous. Next we show that £x is onto. The Hilbert space adjoint £^ of 
£x is defined by 

{8xu,p)^^^{u,rx0)^^^. (4.51) 
We now calculate the adjoint by using the representer to good effect. 



N 



i=l 



N 



N 



i=l 



i=l 



so that 



N 



N 



(4.52) 



In Corollary [T33 it was shown that the functions {Rxii)}f=i form a basis for Wg,x- Hence range£^ — 
Wq.x and null£^ — {0}. We now recall the closed-range theorem e.g. Yosida [24,, which states that 
for a continuous linear operator S the ranged is closed iff ranged* is closed. Since range £^ = Wq.x is 
finite dimensional it is closed so we conclude that range £x is closed. Consequently, using the result that 
rangCiS — (nuUiS*)^ for any continuous linear operator S, we have 

± 



range fjf = range (Sx) = (mill£*x) = {0}^ 



Finally, from ICTl £xu = iflF £xu, f3) = for all /? e iff u, £^/3 =0 for all /3 G 



But range = Wg,x so £xu = iff (u, f)^ g = for all / e Wg,x i-e. iff u e Wq x- 



Part 3 That 



--x 



X 



is an elementary property of the adjoint. Now 



N N 

-.1 j=i 



N 



/3i/3j- {Rxi-),RxU))w,e 

N 

J2 /3,^i?.(o 



N 



— T 

= P Rx,xP, 



so that. 



X 



max 



\£'xl3\\ 



m 



' — max — — = max , and this expression is the 



m 



m 



largest (positive) eigenvalue of the Hermitian matrix Rx.x- But this is also the value of ||i?x,x|| so 



\Rx. 



Part 4 



N 



N 



£x£*x(i^£x = 



Part 5 By part 2 Theorem [1241 K = ^ for j < M 



M \ / Af 



' M \ 



i^l^Af 
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Part 6 By part 1, £x : ~> is onto and null fx = W^^. By part 2, f ^ : ^ Wg,x is onto 



and 1-1. These facts directly imply Sx^x '■ X^~*Wg.x is onto and nuWEx^x = x- 

N N 

(i*xSxf) (x) = {s*xSxf, R^)^^^ {Sxf,SxR.) - 5] / {x^''>) R. (xO)) - ^ / (x'^")) i?,<„ (x) , 
SO that 

N 

(4.53) 

Also fefx/) (x) = (/, f^fxi?.) , but by £*x£xRx = £ i^) RxU) , so that 

\ / \ J w,S j—i 



N 



£*xSxf){x)= |/,^i?,u, {x)R, 

3 = 1 



Part 7 We must show that yVSx'^j (^) = oi^Lxl {x). 

N N N M 

(vi*xaj (x) ^VY^ ajR^u) (x) = ^ ajVR^ui (x) = XI XI ^^<^> 

TV M 

Y^a.Y^Ra^ (x^=^)h{x) 



j=l j=l j=l i=l 

N M 



3 = 1 1=1 
N M 



3 = 1 i=l 

a^Lxl (x) . 



Part 8 Since Lx = {Ij (a;(*))) 



M M 



3=1 3=1 



4.9 Variational interpolation with basis functions 

The mathematical machinery we have developed above will now be applied to studying two variational 
interpolation problems. These will be called the minimal norm and minimal seminorm problems respec- 
tively. The minimal seminorm problem will involve minimizing the seminorm of the space X.^ over the 

functions in which interpolate the data points { (a;^*-* , j/i) . The minimal norm problem will involve 
minimizing the Light norm of the space over the functions in X^ which interpolate the data. We 
show the minimal norm problem has a unique solution and then show the minimal seminorm problem 
has the same, unique solution and that this solution lies in the finite dimensional space Wg,x where G is 
an order 9 basis function of the weight function w and X — {x'^^^fLi i.e. the solution is a basis function 
interpolant. A matrix equation is also derived for the coefficients of the basis functions. 

To render the interpolation problem meaningful we suppose the weight function w has weight properties 
W2 and W3 for order 6 and smoothness parameter k, so that X^ is a space of continuous functions. 
Further, the conditions on w allow us to define a continuous basis function G of order 9. 
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4-9.1 The minimal seminorm interpolation problem 

The scattered data set to be interpolated consists of interpolating the N data points 




x^*) e M"*, x^') distinct, yi e M. 



We call X — {x'-*'}^]^ the independent data and y — the dependent data, and the data wiU 

sometimes be referred to as y]. The points in X are not completely unconstrained because it will be 
assumed that X is unisolvent with respect to the polynomials Pg (Definition . We now require that 
a minimal seminorm interpolant ui satisfies 

l"/L,e=™n{|w|^^g:MGX^,; ui (a;W) = y,, i = l,...,iv}. 
4-9.2 The minimal norm interpolation problem 

Since the independent data X is 6*- unisolvent, from Definition [H] there is at least one minimal unisolvent 
subset of X, say A. Denote by b the dependent data corresponding to A. The Light norm ||-||^ g of 14.291 
is now constructed using A. The scattered data is the same as for the minimal seminorm interpolation 
problem i.e. the minimal norm interpolant uj satisfies 

g = minjllM/ll^ g -ueX^, UI (x^^^) = y, for t ^ 1, . . . , (4.54) 

Using Hilbert space techniques, we now want to do the following: 

1. Show their exists a unique minimal norm interpolant. 

2. Show their exists a unique minimal seminorm interpolant. 

3. Show these interpolants are identical. 

4. Show the interpolant is a basis function interpolant lying in the space Wg.x i-e- it can be written 
as a linear combination of data-translated basis functions plus a polynomial of degree less than 6. 



4-9-3 Solving the minimal interpolation problems 

In this subsection we show the minimal norm interpolation problem has a unique solution which we 
call the minimal norm interpolant. It is then shown that this solution is also the unique solution to the 
minimum seminorm interpolation problem. We then derive a formula for this solution which implies that 
the solution lies in the finite dimensional space Wg,x introduced in Definition 11301 The last result will 
allow us to derive matrix results for the interpolant in the next subsection. 

Theorem 140 Endow X^ with the Light norm IHI^g defined by \4-29\ using A. Then there exists a 
unique minimal norm interpolant. In fact, given y € M.^ there is a unique interpolant ui € X^ such that 

W'^iWwfi = ™n{ll^lL,e - ueXl and £xu = yj . (4.55) 

If V X^ is any other interpolant satisfying £xv — y then 

hiWl.e + Ik - uiWl g = ' (4-56) 

or equivalently 

{v-ui,ui)^g = 0. (4.57) 

Proof. Now by part 2 of Theorem 11391 the evaluation operator £x ■ X^ is continuous and onto, 

and since the singleton set {y} is closed, it follows that the set 

|u : £xu = yj = £x^ (y) , 
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is a non-empty, proper, closed subspace of the Hilbert space X^. Hence this subspace contains a unique 
element of smallest norm, say uj, which satisfies equation 14.551 If fx^" — y then 



Now 



|u : M e X'^ and £xu — = — s : s ^ null£x| 



min — sll^e^sG null£x| — dist (^v, millSx 



is the distance between v and the closed subspace null £x ■ Therefore there exists a unique si G null £x 
such that 

ui^v~si, (4.58) 



and 



\^i\\l,e + \\y~^i\\le-Mle- (4-59) 



Substituting for sj in 14.591 using 14.581 yields 14.561 Equation 14.571 follows since it is a necessary and 
sufficient condition for 14.561 to be true. ■ 

Theorem 141 The unique minimal norm interpolant uj of Theorem \14C\ is the unique minimal semi- 
norm interpolant. In fact, suppose y G M.^ . Then 

\'^i\w,6 = min{|wL,e -.ueXl, and £xu = y| . (4.60) 

If V is any other interpolant satisfying £xv = y then 

\Mwfi + \v -ui\l,^g^\v\l,^g, (4.61) 

or equivalently 

{v-ui,ui)^^g = Q. (4.62) 

Proof. Recall that the Light norm W?I^ for the minimal norm interpolant problem 14. 541 was constructed 
using the minimally unisolvent subset A of independent data which had corresponding dependent data 
y'. Since £xf = y 

11/11',,. = 1/1^.+ E \fi^^^' - \f lie + \yf^ 

By Theorem 11401 there exists a unique minimal norm interpolant uj such that 



and hence 



SO that 



ll"/IL,e = ™m g -.ue Xl and £xu = y} , 

+ \b\^ = min||u|^_g + \y'f : u £ X^ and £xu = ?/| 
= min g -.ueXl and £xu = yj + \y'\^ 

hiWw.e = g : u € X'^ and £xu = ?/| . 



To prove equalities HSU and HH] first note that if £xf = then ||/||^ ^ = \f\lg + Y^tU \f{x^'^)\ = 
l/l^ g. Thus, since £x {v ~ uj) = 0, 

\'^i\l,,e + 1^' - Mwfi = + II" - "/IlL.e = \Wi\\wfi - + 11^^ - "/^e 

= \\v\\l,e-\y'\\ byWm 

I |2 
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which proves [¥.611 To prove ff!^ we use equation 14.571 to obtain: 

M 

0= {v- ui, ui)^g = (f - ui, ui)^g + (^^'O (^^'■') = ('"^ "-T' '^i)w,e > 

i=l 

since v (x^*^) = u/ (x^*^) for i = 1, . . . , iV. ■ 

There is a very close connection between the minimal norm interpolants, the space Wg,x and the 
adjoint £x 14.521 of the evaluation operator £x- The next theorem describes this connection and char- 
acterizes the space of minimal norm interpolants associated with a given unisolvent set of independent 
data points X. 

The minimal norm interpolation problem was formulated using a Light norm ||-||^ g 14.291 constructed 
with a minimal unisolvent set A G X and the corresponding cardinal basis of A. In the next theorem we 
will also construct the Riesz representer 14.351 using A and its cardinal basis. Then by Definition 11281 
the reproducing kernel matrix Rx,x is given by Rx,x = {Rx(J)ix^^^)) ■ 

Theorem 142 We know from Theorem \140\ that for given dependent data [X;y] we can associate a 
unique minimal norm interpolant uj G X^. In fact 

ui = rx {Rx,xV^ V e Wg^x, (4.63) 
and the space of all minimal norm interpolants is Wg,x- Here Rx,x is the reproducing kernel matrix. 
Proof. From parts 3 and 4 of Theorem 11391 SyrEv — Rx.x and so 

Sx^xv = [{£*xy) {x^'^)) = Rx,xy, 

where Rx,x is regular by part 2 Theorem 1 1291 In general Rx.x 7^ / so in general Sx^xU 7^ U ^xV 
is not an interpolant of y. 

However, Sx^x (Rx.x) ^ = I, so £x (Rx.x) ^ y is an interpolant and 

£x {Rx,x)"^ y G Wg,x. For convenience set u = £*x {Rx,x)^^ y- We want to show that u = uj. But 
since both ui and u interpolate y 

{u,ui -u)^g = [£*x {Rx.xV^ y,ui -u] = {{Rx,xT^ y,£x (ui - u)) 

= 0, 

and so 

If u 7^ ui then llitjl^g < ||it/||^g, contradicting the fact that uj is the minimal norm interpolant. 
Because Rx,x is regular, {Rx.x)^^ is an isomorphism from to M^, and because £x is an isomorphism 
from to Wg,x, the formula uj = £x {Rx,x)~^ y imphes that range {Rx,x)~^) = Wg,x. ■ 



4.9.4 Matrix equations for the minimal seminorm interpolant 

We now know from Theorem 11421 that the minimal seminorm interpolant lies in the finite dimen- 
sional space Wg,x- Hence we should now be able to derive a matrix equation for the coefficients of 
the G (• — x^'^^y This equation will be constructed using the basis function matrix and the unisolvent 
matrix. This will require the following lemma which turns out to be very useful since it provides key 
results for a block matrix which has a structure central to the study of the matrix equations in both 
basis function interpolation and basis function smoothing theory. 

Lemma 143 Let B be a complex-valued matrix and C be a real-valued matrix. Suppose the block matrix 
B C 

IS square. 



o 

Suppose further that for complex vectors z 



z'^Bz = and C'^ z = implies z = 0. (4.64) 
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1. Then the equation 

B C \ ( u \ f 



^ O I \ V J \ 
implies u — and v G nuUC 
2. If, further to part 1, null C = {0} then the block matrix is regular. 
Proof. Part 1 We proceed by showing that 

implies u = 0. Expanding this block matrix equation yields Bu + Cv = and C'^u = 0. Thus 

= u^iBu + Cv) = u^~Bu + u^Cv = u^Bu + [C^ufv = u^Bu, 

and so iI^Bu — 0. Set x = u. Then x^Bx = and C^x — 0, and so 14.641 implies x — 0. Hence u — 
and Bv = 0. 

Part 2 Clearly if nuUC = {0}, by part 1 the block matrix has null space zero and so is regular. ■ 
We now derive the matrix equation for minimal seminorm interpolant: 

Theorem 144 Suppose {pj}^Li is any basis for Pg. The space Wg,x contains only one minimal semi- 
norm interpolant uj to any given data vector y G R^. This minimal seminorm interpolant uj is given 
uniquely by 

N M 

ui {x) =51"'^ - ^^'0 + (^•'^5) 

i=l j=l 

where the coefficient vectors v = (vi) and (3 = {Pj) satisfy the matrix equation 



Gx,x Px \ I V \ _ ( y 

X 



Px O ) \ 13 ) \Q 



(4.66) 



Here Px is the unisolvency matrix (a;^*-*)) and Gx,x is the basis function matrix [G (a;*-*^ — a;^^')). 



G P 

Also, the matrix ( ^j^' ^ ) has size {N + M) x [N + M) and is regular. 



Proof. By Theorem 11421 Wg,x contains only one minimal seminorm interpolant. Using equation 14.651 
and the interpolation requirement ui (a;'*-*) = yi we obtain the pair of equations 

Gx.xv + Pxfi = 2/; P^v = 0, 

or in block matrix form 

Gx.x Px \ ( "v \ _ ( V 



Pi O ) \ p ) \Q 

By part 3 Theorem 11341 v"^Gx,xv = and P^v — implies t; = 0, and since X is unisolvent, part 1 
Theorem 11041 implies nuUPx = {0}. Thus, by Lemma [1431 above, the matrix of 14.661 is regular and the 

interpolation problem has a unique solution ^w"^, . ■ 

From part 1 Corollarv ll37l {i?3.fi^ }iLi is a basis for Wg,x ■ In the next theorem we give the corresponding 
matrix equation for the minimal norm interpolant. 

Theorem 145 We know from Theorem \14U\ that for given independent data X — {a;*-*-*} and de- 
pendent data y G M.^ we can associate a unique minimal norm interpolant uj G X^. In fact, if 
Rx,x = {PxU) (^'■*')} is the reproducing kernel matrix then 

N 

= ^ ViR.j,{^) , when Rx.xv = y, (4.67) 
1=1 

where is the Riesz representer of the evaluation functional f ~^ f {x) . 
Proof, ui = £*x {Rx.xY^ V = £-*xV = X^ili '"iP-A-)- ■ 
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4-9.5 The minimal interpolant mapping and data functions 

The last theorem allows us to define the mapping between a data function and its corresponding inter- 
polant. We call this the minimal interpolant mapping: 

Definition 146 Data functions and the minimal interpolant mapping Ix '■ Wg,x 

Given an independent data set X , we shall assume that each member of X^ can act as a legitimate 

data function f and generate the data vector £xf- 

Equation \4-6S\ of Theorem \14'A enables us to define the linear mapping Ix '■ X^ — > Wg,x from the 

data functions to the corresponding unique minimal interpolant Xx f = ui given by 

Ixf = £*x [Rx,xr^ £xf, f e Xl (4.68) 

The purpose of the minimal interpolant mapping will be to study the pointwise convergence of the 
interpolant to its data function. 

Theorem 147 The minimal interpolant mapping Ix '■ X^ Wg,x has the following properties: 
1- \\Ixf\L^g < ll/L,, and \\iI-Ix)f\L^g < ll/L,,. 

2. |Xx/U<|/L,e cind\{I-Ix)fL^o<\fL,e- 

3. Ix is a continuous projection onto Wg,x with null space Wq x- 
4-. Ix is self-adjoint. 

Proof. Part 1 Follows from 14.551 since the data function is an interpolant. 
Part 2 Follows from part 1 since Ix is an interpolant. 

Part 3 Part 1 implies continuity. Part 4 of Theorem [131] implies Ex^x ~ Rx,x and Rx,x is Hermitian 
and regular. Hence [¥.681 implies Ix is a projection and thus onto. Further, £x is 1-1 by part 2 of Theorem 
UMlsolUHlimphes Jx/ = iff £x/ = iff / G W^x by part 1 of Theorem [Hi 

Part 4 By mi (Xx/,<?)„e = i£*x {Rx.xT^ £x f , g) = 

^ {{Rx,x)~^ ^xf^^xg) ^ [f:^x {Rx,x)~^^x9] since Rx.x is Hermitian. ■ 

\ / w,Q \ J 10,0 

4.10 Convergence orders for the minimal interpolant 

The estimates for the order of pointwise convergence obtained here are derived using similar techniques 
to those of Light and Wayne in [9J and ^lOj . We use the Lagrange interpolation theory from [T^ and the 
function (x). 

4.10.1 A unisolvency lemma 

To study the convergence of the minimal interpolant we will also need the following lemma which supplies 
some elementary results from the theory of Lagrange interpolation. These results are stated without proof. 
This lemma has been created from Lemma 3.2, Lemma 3.5 and the first two paragraphs of the proof of 
Theorem 3.6 of Light and Wayne [lOj . The results of this lemma do not involve any reference to weight or 
basis functions or functions in Xf^ , but consider the properties of the set which contains the independent 
data points and the order of the unisolvency used for the interpolation. Thus we have separated the 
part of the proof that involves weight functions from the part that uses the detailed theory of Lagrange 
interpolation operators. 

Lemma 148 Assume first that: 

1. Q, is a bounded, open, connected subset ofW^ having the cone property. 



2. X is a unisolvent subset of Q. of order 0. 



104 4. The basis function interpolant and its convergence to the data function 

Suppose is the cardinal basis of Pg with respect to a minimal unisolvent set in Vl. Using Lagrange 

interpolation techniques, it can be shown there exists a constant K'^^ g > such that 

M 

and all minimal unisolvent subsets of^l. Now define the data density by 

hx = sup dist (w, X) , (4.69) 

and fix X Cz fl. Using Lagrange interpolation techniques it can be shown there are constants cn^g, hfn^g > 
such that when hx < h^^g there exist a minimal unisolvent set A <Z X satisfying 

dianiAa, < c^^ghx, 

where Ax ^ AU {x}. 

Remark 149 If loi is one of the furthest points in fl from X then hx = dist(wi,X). hx can also be 
interpreted as the radius of the largest sphere centred in f2 that can be placed between the points in X . 



4-10.2 An upper bound for a/ (x) 

Theorem 150 Suppose w is a weight function with properties W2 and W3 for order 9 and n, and that 
G is a basis function of order 9. Suppose A — {flfelf^]^ is a minimal 9 -unisolvent set and that {Ik^'^^i is 
the corresponding unique cardinal basis for Pg. Now construct V, Q and using A and {^fcltLi- Then 
if rx = QRx 

, ,m/2 / \ 

V^)< . , \l + y^\h{x)\\{dmmAxf max \D^G{y)\, xeW, 

^ ' V V \ ^-i / |i;|<diamA^ 

where r\ = min {9, ^ [2kJ } and Ax ~ AU {x}. 

Proof. From part 4 of Theorem[nni (y) = {rx,ry)^ g so that (x) = \rx\t,,g > 0. 
Also from Theorem [1251 (y) = (27r) ^ QyQxG {y — x) when x ^ y. 

Now from Theorem [50l or l49l G G Cgp^^ ^ and on expanding G about the origin using the Taylor's 
series with integral remainder in the Appendix IA.8I we get 

G{y-x)^ J2 ^^^(i?^G)(0)+7^2„(0,^/-x). (4.70) 

\f3\<2v 

To calculate rx (y) apply the operator QyQx to 14.701 and then, noting that 2r/ < 29, use Theorem lllSl to 
eliminate the power series and obtain 

i"x {y) = (27r) 2 QyQxTZ2rf {0,y- x). Expanding Qy and Qx using Vy and Vx now gives 

{2Tr)i rx (y) = 7^2^ (0, y - x) - Vx (7^2^ {0,y~x))- Vy (7^2^ (0, y - x)) + VyVx (7^2^ (0, y ~ x)) 

M M 

= 1^27) (0, y - x) - ^ 7?.27, (0, y - aj) Ij (x) ~ ^ n2r, (0, ak - x) h (y) + 
j=i k=i 

M 

+ ^ 1^271 (0, Ok - Oj) Ij (x) Ik (y) , 

so that 

M M 

{2tt)Kx{x) < ^|7e2^(0,a;-aj)l (a;)| + ^ |7^2^ (0, afc - x)| |/fe(a;)| + 
j=i k=i 

M 

/M \ f V 

- 2 ( ^ l^fc (a;)| 1 max|7^2,, (0,x - flfc)! + ( ^ |?fc(^)|J max |7^2^, (0, - aj)| . 
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The remainder estimate IA.4I for the Taylor series in Appendix IA.8[ namely 

|7e2,(0,fo)|<-i^ max \D^Giy)\, 
is now applied to the last inequality to obtain 



(2^)2r,(x) < 



2\y2\^kix)\\ (^max\x-ak\^ max lol^Giy) 

\k=l / U,l<-rlii,m A 




M \ 2 

^|Zfc(a;)| (max|aj- 
k=i ) ^ 



|y I <diam 

flfcl max \D^G{y)\ 

|y| <diam 



M 



< ( 1 + El^fe(^)lj (diamA,)^'' max |i?^G(2/)|, 



SO that 



M 



. , l + (diam^.r max |i?^G(y)|, 

as claimed. ■ 

4-10.3 The order of pointwise convergence of the interpolant to its data function 

The result of the previous subsection now allow us to prove the pointwise convergence of the minimal 
interpolant to its data function and to derive an order of convergence. The concept of interpolation error 
and convergence go hand in hand. The interpolation error is simply the difference between the interpolant 
and the data function at a given point. 

Before deriving the interpolation error estimate I will show that there exists a nested sequence of 
independent data sets with sparsity tending to zero. 

Theorem 151 Suppose fl is a bounded, open set containing all the independent data sets. Then there 
exists a sequence of independent data sets X''^^ C fl such that X''^^ C X^'^^^'^ and as k oo. 

Proof. For k — 1,2,3,... there exists a finite covering of by the balls 

|i3 ^a[^'''; -^^ I . Construct X'^^^ by choosing points from Q so that one point lies in each ball 

B (^a^i^^;lj. Construct by first choosing the points X^''^ and then at least one extra point so 

that X^''^^^ contains points from each ball B ^a[{^]^; -^^^ ■ 

Then x €z flD X'*^) implies x ^ B {^^^^ ] for some j and hence dist (x,^^*'^) < ^. Hence hxik) = 
sup dist (x, X^^)) < r and Hm hxw = 0. ■ 

The next theorem derives an upper bound for the uniform pointwise error of the minimal interpolant 
in terms of the product of the seminorm of the data function, a power of the sparsity of the independent 
data and various constants derived from the theory of Lagrange interpolation. 

The order of uniform pointwise convergence is defined to be the power of the sparsity parameter, in 
this case min |0, ^ L^^J} where 9 and k are the weight function parameters. 

Theorem 152 Let w he a weight function with properties W2 and W3 for order 9 and smoothness 
parameter n. Set i] — min |0, ^ [2kJ } . 

Suppose the notation and assumptions of Lemma \148\ hold with the data point sparsity of X in Q 
defined by hx — sup dist (lj; X). Suppose also that Xx is the minimal interpolant on X of the data 

function fd G X^. 

Then there exist positive constants cnfi, hn,e, K'n g and 
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\fdix)-Jxfdix)\<\fd-IxfdLgkn,e,^icn,9hxf max \D'^G{y)\, x eTl, (4.71) 

l/3|=2i) 
\v\<cn,shx 

when < hx < g. The Lagrange interpolation constants cq g, g and g are derived in Lemma 

m ' 

Further, \fd~^xfd\^^g < \ fd\^^g and the order of convergence is 77. 
Finally we have the bound 

\fd (x) - Ixfd {x)\ < \ fd - Ixfdl^a 9 ^i2,e,r, (diaml^)'' max Id'^G (y)| , x e Q. 

\0\=2r] 
|y|<diam Q 

Proof. Fix x e 51. Since Tx interpolates the data from the function fd it follows that Txf (x) — f (x) 
when X e X. Thus V {fd ~ Ixfd) = and hence fd-1xfd = Q {fd - Ixfd)- 



fd {x) ~ Ixfd {x) = {fd - Ixfd, Rx)^,,g ^{Q{fd- Ixfd) , QRx)^,,g = {fd - Ix fd- r. 



But by part 4 of Theorem 11251 l^-a;!^ g = ^^r^ {x) and thus 

\fd{x)-Ixfd{x)\<\fd-IxfdL.g\r.L.g = \fd-IxfdL.gV^- (4-72) 



The upper bound for -^Z r^ {x) given by Theorem 11501 is 



2 



Vrx {x) < , ^ l + y|^fc(a;)| (diam^,)'' max \D'^G{y)\ 



so that by Lemma [1481 



2 



^ \y\<csi.0hx 



d^il + K' 



V^)< . , (1 + (co.e/ix)" max \{DPG){y)\, (4.73) 

when hx < h^^. Therefore 

\fd{x)-Ixfd{x)\ < \fd-IxfdL,g \ ^ {cnAxf max \{DPG){y)\ 

(27r)^ 7(2^ , m=2v 

< \fd—Ixfd\^gknfi,-q{cn,ehx)^ max \{Df'G){y)\, xen, 

l/3|=2)) 
\y\<cn,ehx 

when hx < h^^g. The last inequality can be extended to 17 because the inequality is uniform on fl, 
is bounded and fd — Ixfd is continuous on R'^. That \ fd — Ixfd\y, g < l/^L e was shown in part 2 of 
Theorem [HTl 

The final bound is true since diamAj^ < diamfJ. ■ 

Remark 153 Lf k < 1/2 then rj = and the last theorem only shows the interpolation error is bounded 
i.e. zero order of convergence. In the next section we show how to overcome this limitation and obtain 
positive convergence orders for these cases and improved orders of convergence when k > 1/2. In the 
process we will demonstrate improved order of convergence estimates for almost all thin-plate splines and 
shifted thin-plate splines. 



4.11 Slightly improved convergence results 

Noting Remark 11531 to the last lemma in the previous section, we will show how to obtain improved 
interpolant convergence estimates using a Taylor series expansion result for distributions. Our results 
will be illustrated using the thin-plate splines and the shifted thin-plate splines. The improvement in 
convergence order for these examples is at most 1/2. 

To prove Lemma 11551 we will require the following result: 
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Lemma 154 Suppose u € L]^^ {W^) and (j) e . Then for all b E R'^, 



\u{x + tb)\ \<j> (x)\ dxdt < 



(4.74) 



Proof. Suppose supp</) C B {0;R). Then 



\uix + tb)\ \(l>{x)\dxdt^ J j\u{y)\ \(P{y-tb)\dydt^ J J \uiy)\ (y - tb)\ dydt 

\y-tb\<R 



< 



|y|<_R+|b| 
1 



< 



< 



\u{y)\ \4>{y-tb)\dydt 



\u{y)\ dydt 



\y\<R+\b\ 



\u{y)\dy 



\v\<R+\b\ 



< oo. 



Our Taylor series distribution resuh is: 

Lemma 155 Suppose u € C^"^^"^ (R'^) and the distributional derivatives are Lj^^ functions. 

Suppose also that for each fixed 6 7^ the integrals 



{l-t)"~^\{D'^u){z + tb)\dt, z^beM.'^, 



have polynomial growth in z. Then 



bP 



(z + 6) = — {Df'u) (z) + [Tlnu) (z, 6) , z, 6 e 



(4.75) 



(4.76) 



where 7?.„u is the integral remainder term 

(7^„M) (z, 6) n V — / {l^tf^^ {D^u){z + tb)dt, z.beW^. (4.77) 

Proof. In order to overcome the fact that D^^u may not be C(o) (R'^) when = n, we will use a Taylor 
series expansion with remainder for distributions. Suppose S C^. Then the conditions on u allow us 
to use Lemma 11541 to show that the iterated integrals 14.791 and 14.801 are absolutely convergent and thus 
apply Fubini's theorem to swap the orders of integration in the following calculations: 

\u{z + b),<^{z)\ = \u{z)A{z-b)\ 



|/3|<r 



/3! 



\ o\ ^ ■ -^0 



b^ 



l/3|<r: 



|/3|=n 



(4.78) 
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We now analyze the integral remainder term of 14.781 



; (z) / (1 - i)"^^ {D'^'j)) {z - th) dt dz 
Jo 

(1 - tf^^ J u (z) [z - tb) dz dt 

(1 - tf-^ [u {z) , {Df^4>) (z - tb)] dt 
[u{z + tb),{D'^^){z)] dt 
= i-lf^ C (1 - ty'-^ [{Df'u) (z + i6) , (z)] dt 



(4.79) 



Jo 

= (-1)'^' 



ri-l 



D^u) (z + tb) (j) (z) dz dt 
(1 - t)""^ (Li'^u) (z + i6) (z) dz(4.80) 
(l-t)"~^ (D'^u) (z + t6)di,</)(z) , 



so 14.781 now becomes 



,(z + 6)>(z)] = -^[D^u{z),4^{z)] + 



bP f 

+"E75[ / {l-tr'''{D^u){z + th)dt,ct>{z) 

for 4>eC^. Thus 



m=n 



as claimed. 



Using the previous lemma we now modify Theorem 11501 to obtain the following estimate for y/r^ (x) 
which requires the assumptions 14.811 and 14.8^ to be valid. 

Theorem 156 Suppose w is a weight function with properties W2 and W3 for order 9 and k. Set rj = 
min {9, ^ [2kJ }. Also suppose G is a basis function of order 9 such that the distributions {£''^G}|^|^2,,+i 
are Lj^^ functions such that for each fixed b ^ the integrals 



{l-t)^''\{Dl^G){z + tb)\dt, z,beR'^, 1/31=277 + 1, 



have polynomial growth in z. 

Further, suppose there exist constants rQ,CG,ri > and (5g > such that 
Ib^l f\l~t)^"\{D''G){tb)\dt<^\b\^^''+^''\ \b\<rG, 



(4.81) 



2ry+l, 



(4.82) 



, M 



where a — min {^^, 5 [2k + IJ } ■ 

Regarding unisolvency, assume A — {afcjfli is a minimal 9-unisolvent set and that {'fc}^'^^ 
corresponding unique cardinal basis for Pg. Now construct V, Q, Rx using A and {lk}kLi- 
Then if r^ — QRx we have the estimate 

\Jrx {x) < ^1 + J2 l^fe (^)l j (dianiA,)''+*^ , diamA, < a; e ^i, (4.83) 



where A^ — AU {x} and CG,ri,a 



-CG, 



V 
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Proof. The proof will follow that of Theorem 11501 From part 4 of Theorem 11251 {y) — {vx, fy)^ g so 
that {x) — \rx\1, 0> 0- Also from Theorem 11251 (y) = (27r)^^ QyQ^G {y — x) when x ^ y. 
Since G G cjlp'^J^ and the functions {D^G}. , 

-19 j_i I ^^'^ ^loc conditions 14.811 mean we can use Lemma 

11551 to expand G about the origin and get 

G{y~x)= ^^^(^^G)(0)+7^2.(0,y-a;), (4.84) 

\P\<2a 

where 2a = min{20, [2kJ + 1}. 

To calculate (y) apply the operator Qy Qx to 14.841 and then noting that 2a < 26 use Theorem 11181 
to eliminate the power series and obtain 

_d 

Tx (y) = (Stt) 2 QyQxTi-2a (0, y—x). Expanding Qy and Q X using l^y and l^x now gives 

(27r)^ rx (y) = 7^2a (0, y~x)~Vx (7^2a (0, y - x)) - Vy (7^2a (0, y ~ x)) + VyVx (7^2a (0, y ~ x)) 

M M 

= 7^2(T (0, y - x) - ^ 7^2c^ (0, y - aj) Ij (x) - ^ 7^2cr (0, ak ~ x) Ik (y) + 
j=i k=i 

M 

+ ^ 1^20 (0, flfe - aj) I J [x) Ik (y) , 

3,k=l 

so that 

M M 

{2Tr)Kx{x) < J2\n2a{0,x-a,)\\lj{x)\+Y\n2a{0,ak-x)\\lk{x)\ + 

3 = 1 k=l 
M 

+ E 1^2. (0, flfc - aj)\ \lj {x)\ \lk (x)| 
3,k=l 

/M \ /A/ \2 

< 2 lY\lk{x)\\ uia:i\n2a {0,x - ak)\ + [Y\lk{x)\\ max |7^2o■ (0, - aj)| . 
Set T = 7] + 5q. Then from Lemma 11551 



l/3|=2<T 

and so when \b\ < rc estimate 14.821 implies 



7^2.(0,5) = 2a E (l-tf^-'{Df'G){tb)dt, 



J- |,|2t |,|2t 



2t 



Hence if diam Ax < rQ 



(27r) = r, (x) < 



A/ \ ^ . ^ 2r 



< j^CG,^ h- + Y^Jlk{x)\\ (diamAa;)^^, 



no 
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SO that 

,M. ^ / M 



^ J / \ 



fc=l 



as claimed. ■ 

We can now prove our improved interpolant convergence estimate. 

Corollary 157 Suppose the notation and assumptions of Lemma \14S\ and Theorem \156\ hold. Suppose 
also that Xx is the minimal interpolant on X of the data function fd G Xf^ . 
Then there exist positive constants cn,e, ^n,6i, K'q^ g such that 

\fdi^)-^xfd{x)\<\fd-IxfdL^gV^^{l + K^e)icnMhxr^''' , x eTl, (4.85) 

when < hx < min {/lo^e, ro}. The constants cn,e,K'^ g and h^^g are derived in Lemma \l4-8\ 
Next, \ fd - Txfd\^fi < |/<iL,e so the order of convergence is r] + 5g- 
Finally, for all independent data X 

\fd{x)^Ixfd{x)\ < \fd~IxfdL^ekn,0,^{mm{dia.inn,rG}T'^^'' , x eQ. (4.86) 

Proof. E X eil and diamA^r < ra then from 14.721 14.831 and Lemma [TiSl 



\fdix) ~Ixfdix)\ < \fd~Txfd\^ gV^x (x) 



d~ I / M \ 

< \fd~TxfdL^g ^^"^ 1 + E 1'^ (^)l (diamA.)''+*- 



k=l 



< \fd " IxfdL, (1 + K'^,e) (diam A.)''+^^ 

\fd - 1xfd\^^g ^CG,-qM (l + K[-i.,e) (diam 



Now by Lemma 11481 if hx < then there exists a minimal unisolvent A C such that diamA^; < 
cn,ehx which proves [¥.851 Finally, the estimate 14.861 is true since diamA^: < diamil. ■ 

Lemma 158 Suppose for a given order 9 the weight function w has property W3 for some k. Then one 
of the following must hold: 

1. For some s > k, w has property W3 for all < k < s and does not have property W3 for n > s; 

2. For some s > k, w has property W3 for all < k < s and does not have property W3 for k > s; 

3. w has property W3 for all k > i.e. s — oo. 

Proof. This result follows from the fact that if property W3 holds for k = kq then W3 holds for all 

< K < Kq. ■ 

The examples of this section will have either property 1 or property 3 of the last lemma and these 
examples will be concerned with finding the 'maximum' order of convergence given the constraint applied 
to K. Now rj = max min {d, [2kJ } is the maximum order of convergence defined by Theorem 11501 To 



this is added an increment of convergence order defined by Theorem [1561 The following result will be 
used to calculate rj and a when the weight function has property 1 or 3 of the last lemma. 

Theorem 159 Given s > suppose w is a weight function with properties W2 and W3 for order 9 and 

all K < s. Set ri = max min i9, ■k I 2k 1 1 and a = max min 1 0, ^ I 2k + 1 1 1 . 

o<K<s ^ ' Q<K<s I ^ L J J 

Then 

_ ( min {9, i [2sJ } , if 2s is not an integer, , , 

^ [ min {9, s — i} , if 2s is an integer. 

If s <e then 

f i |2s| , if 2s is not an integer, 
s — I J Is IS an integer. 
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If s > 9 then 
Regarding a: 



a = 



min {O, ^ [2s + IJ } , if 2s is not an integer, 
min{9,s}, if 2s is an integer, 



and a is related to rj by 

^ _ r 7?, [2s\ > 29, 



(4.89) 
(4.90) 

?y+i [2s\<29-l. ^^-^^^ 
Proof. Let 77^ = min |0, ^ \ 2n\ }. Suppose 2s is not an integer and < £ < 2s — \ 2s\ . Then 

?7 = max ^77^ : ^1 — — ^ s < k < s| > min — 2 ^1 — — ^ j" ^ ™^ {^^' 2 ^ 

> min |6I, i [2sJ 

but 77 = max {77^ : < < s} < max {77^ : < k < s} < min ^ [2sJ } so when 2s is not an integer 
it follows that rj = min \ 9, i [2sJ } . 
If 2s is an integer then 

77 = max {77^ : < K < s} = max {77^ : < 2k < 2s} 

= max {7;^ : 2s — 1 < 2k < 2s} 

= max jmin ^ [2kJ | : 2s - 1 < 2k < 2s 

= max jmin ^^9, ^ (2s - 1)| : 2s - 1 < 2k < 2s 
1 

mm < f , s 

^ ' 2 

To prove suppose s < 6*: If 2s is not an integer then bv l4.87[ 77 = min {9,\ [2sJ}. But \ [2sJ < 
i Y29\ = 9 so rj = ^ [2s \ . If 2s is an integer then again by 14.871 7/ — min |6', s — i} = s— i. 

To prove suppose s > 6': If 2s is not an integer then 77 — min {9, ^ [2sJ } = If 2s is an integer 
then 77 = min {0, s - i}. But 2s > 29 imphes 2s - 1 > 20 i.e. s ~ ^ > 9 and 7/ = 9. 

Let (T„ = min {9, ^ [2k + Ij }. Suppose 2s is not an integer and < e < 2s — [2sJ . Then 



a — max |(7k ■ ~ ^) s < < s| > min 'l^' 2 



.V 2s/ J 2 
= min|0,i L2s-£j +^ 

>minS^9,^[2s\+^Y 

but a = maxjcr^ : < k < s} < maxjcTK : < k < s} < min {0, ^ [2sJ + i} so when 2s is not an 
integer it follows that 77 = min j^, ^ [2sJ + |} = min {9,^ [2s + Ij }. 
If 2s is an integer then 

a = max {a^ '■ < k < s} — max {cr^ : < 2k < 2s} 

— max {(7^ : 2s — 1 < 2k < 2s} 

= max |min ^ + ^ | : 2s - 1 < 2k < 2s 

= max jmin 1^9, ^ (^-^ - 1) + ^| : 2s - 1 < 2k < 2s 
= min {9, s} , 
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which proves [¥.901 

Finally, ion is proved by using li^^ and KE7\ to calculate a and for [2sJ > 29 and [2sJ < 26* - 1. ■ 
Next we will illustrate the theory of this subsection by using as examples the radial thin-plate splines 
and shifted thin-plate splines which were among the positive order basis functions studied in Chapter [2l 

Example 1: The thin-plate splines 

We will derive the combinations of 77 and Sg for which the thin-plate spline basis functions satisfy the 
requirements of Theorem 11561 Corollary 11571 then tells us the orders of convergence of the interpolant 
are rj + Sg, which is an improvement of <5g. 

The thin-plate spline weight and basis functions were studied in Subsection 12.3.11 of Chapter O By 
Theorem 1711 the equation 

^(0 = 4tI^I"''^''^'' (4.92) 
e(s) 

defines a thin- plate spline weight function with properties W2.1 and W3.2 with positive integer order 
9 and non-negative k iS k < s < 9. The corresponding basis functions are defined by 

^/^N / (-l)'^'|2^l''log|a;|, s = 1,2,3,..., 

y (-1)' '\x\ , s > 0, s 7^ 1,2,3, . . .. 

Now suppose K < s < 9. 

Case 1 < s < s ^ 1,2,3,.. .1 Bv li^Ml G (x) = (-1)^"^ This is a homogeneous function of 



degree 2s and hence for some constants fcg „ — max max ID'^G (x)\, 

\l3\=n\x\ = l^ " 

\D^G{x)\<Kif,l\xf'-^^^, /3>0, (4.94) 

and so L^^G G L^^ iff 

\P\ -2s<d, (4.95) 

and for all /? > 

{l-tf'\{D^G)iz + tb)\dt<K^\p\ Iz + tbi^'-^^^dt. (4.96) 



We want to apply Theorem 11561 which assumes |/3| = 21] + 1. From Theorem 11591 V — L^sJ so 
2s - |/3| = 2s - 277 - 1 = 2s - [2sJ - 1 and -1 < 2s - < which means HH] is satisfied. Hence 



1 1 

J \z + bt\'''-^''Ut< J \\z\-\b\t\^'-^''Ut=\b\ 



2S-I/3I 



\b\ 



dt 



1^1161-1-1 
1 + 1^1161-1 

<2\b\^'-\^\ I u^^-^f^du 





^ 2|6|^-"l^l A ^ N ^ '^-'''1+' 



2s-|/3| + lV \b\ 
< 00 



and 14.961 implies 

which in turn implies polynomial growth in \z\. 



2s-|/3| + l 
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When z = 0, SH] implies 



l&l 



l/9| 



«s,|/3| 



2(2s + l- 

ks,\l3\ 



\b\' 



2(2s + 1 



l&l 



2s 



We want an estimate of the form l4.821 But from Theorem 1 1591 V — ^ L^^J so 2s = 2r/+ (2s — [2sJ) and 
we can write 2s = 2t] + 2Sg where Sq — s~ ^ [2s \ < ^. Hence vahd values of 6g are < Sg < s— ^ [2sJ. 
Note that < s — i [2sJ < i and that s — i [2sJ = iff s = n or n + i for some integer n > 0. 



Case 2 s = 1,2,3, . 



- 1 



To apply Theorem 11561 we need to estimate the derivatives 
{D'3G}|^l^2^^r froi^^ Theorem [HSl 77 = s - i so that \(3\ = 2r/ + 1 = 2s. 

Next, EIHl implies G(a;) = (-1)^+^ |x|^^log|x| for s = 1, 2, 3, . . . , 6* - 1. But any first order derivative 
of log |x| is a homogeneous function of order —1 so there exist constants ks^\f3\ and k'^ |^| such that 



\D^G{x)\ < Ixp^-I'^l |log|x|| + \x\''-\^^ 
and when 1/31 — 2s 



|/3| l^'l ■ ■ |iog l^'l I + t's,!/?! I^'l ■ ' < |/3| < 2s, 



|i^^G(a;)| <fc,,2.|log|a;||+fc;,2„ \f3\ = 2s. (4.97) 

Now |log |x|| G Lj^^ iff J|.|<;^ |log |a;|| dx < 00 and by using spherical polar coordinates (r, (f)) e.g. Section 
5.43 Adams it is straight forward to show that this integral exists because r'' |logr| S Lj^^ (^^)- 
Further, the integrals 14.811 satisfv the inequalities 



{l~-tf'^\{D'^G){z + tb)\dt < / KdI^G) {z + tb)\dt 

Jo 

< / \\og\z + tb\\dt + k',^2s\b\'^l dt 

Jo ' Jo 



ks,2s / \\0g\z + tb\\dt + k',^^,\bf 



(4.98) 



Suppose d ^ 1. Then if + < 1 and \z\ < 1 then \log\z + tb\\dt = i /^""^^ |log |t|| rfr < 
f^^ |log|T|| dr = |. Otherwise, if |z + fe| > 1 or \z\ > 1 then set oi = max{|z + b\ , \z\} so that 

|log \z + tb\\dt^^ |log |r|| dr < i y |log |r| | dr + ^ ^ |log |r| | dr 



2 2 
b^bJi 



aidr 



proving that when d = \ the integrals 14.811 have polynomial increase in z for any given 6 7^ 0. 
Now assume d> 1. To evaluate |log + tb\ \ dt first observe that the interval [z, z + b\ can be rotated 
so that 61 > and bi = for i > 2. To this end set z = (zi, z') so that 



|log|z + t6||dt = / |log|(zi + 6ii,z')l|rfi 



1 
1 



log((zi+5i<)V|zf) 
log((zi+5i<)V|zf ) 
If jz'l > 1 then z and z + 6 both lie outside the unit sphere and 

y |log|z + t6||dt < iy ((2i + 6i)' + z2)dt=i((zi+6i)Vz2) <|z|V|5r 



dt. 



(4.99) 



(4.100) 
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If \z'\ < 1 and z and z + b both lie inside the unit sphere we have (zi + bit)^ + \z'\^ < 1 and 
^ |log|z + i6||dt<-^^ log(|2:i + M|')dt = -j^^' 'log|s|ds 



2 '•1 







= (4.101) 

If |z'| < 1 and z and z + 6 do not both lie inside the unit sphere set oi — inax{|zi| , |zi + > 1 so 
that bv 14:991 



j\log\z + tb\\dt < i^'|log((zi+&it)V|z'| 

1 fZl+bi 



dt 



^ ^ ' log (r^ + |zf ) dr + ^ / logfr^ + lzfj^T 



\b\h ' ' W \b\]^ 



'1-2? 



< 



and since log rdr = 1, ai < |z| + \b\ and |z'|^ < |z|^ it follows that |log \z + has polynomial 

increase in z. Indeed, combining this result with the estimates 14. 1011 and 14.1001 we can conclude that the 
integrals 14.811 have polynomial increase in z when d> \. 

Finally, when z = choose tq = \. Then ITMl implies that when \b\ < re and < e < s: 

|^|l/3| f\i-tf^\(D^G){tb)\dt < h,2s\b\^' [' \log\tb\\dt + k'^^^^\bf' 



Jo 



fc.,2.i6r'(^ \ogUt+ \\og\b\\dt^+K^2Abt 



= ^^2. {\br |l0g \b\\) \bf'-'^ + (fc,2. + K^,s) 

where Cs,e = fc^ 2s "lax ( l^]^" |log ) + fcs.2s + fc^ 2s- 

|6|<rG V / 

The estimate 14.821 requires that rj + Sg = s — e where 6g > 0. But i] = s — ^ so Sg — — £ where 
< e < i. 

Conclusion vg — I and regarding the validity of 14.821 

If < s < 6*, s 7^ 1, 2, 3, . . . then we can choose Sg = s — ^ L2sJ ■ 
If s = 1, 2, 3, . . . , 61 - 1 then|4l2|is valid for all < 6g < ^■ 

Example 2: The shifted thin-plate splines 

We will derive the combinations of rj and 6g for which the shifted thin-plate spline basis functions 
satisfy the requirements of Theorem 11561 Corollary 11571 then tells us the orders of convergence of the 
interpolant are rj + Sg, which is an improvement of Sg- It turns out that we can choose any value of Sg 
such that Sg < 1/2. 

The shifted thin-plate spline weight and basis functions were studied in Subsection 12.3.21 of Chapter 
[H The shifted thin-plate spline weight functions are defined by 

^(g)- ^, ,~ ^ , „j er''+'^^', s>-d/2, (4.102) 
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where 

and K\ is the modified Bessel function of the second kind of order A. The functions defined by 



^ (-l)f'l fo^ + lrcl') , .>-<i/2, »it 1,2,3,,,, 



where a > 0, are shifted thin-plate sphne basis functions. In fact: 
Theorem 160 (From Theorem [7^ 

1. w has weight function property Wl w.r.t. the set A = {0}. 

2. w also has weight function properties W2.1 and W3.2 for and all n > iff —d/2 < s < 6. 

3. If ~d/2 < s < 6 then G is a basis function of order 9 generated by w. 

4- If t > 2s there exists a constant Ct such that \G {x)\ < Cf (1 + for all x. 



From Theorem 11601 we know that the weight fimction has property W2 for aU k > 0. Thus G G G°° 
and 

D^GeLl, f3>0. 

By a cunning trick we can modify the calculations used for the thin-plate spline in the first example. 
This is done by letting the constant a E M.^ vary and writing G = G (y) where y = (a, x) G R'^+^. Now, 
like the thin-plate spline basis function, G is a homogeneous function in y of order 2s and we can use 
the nice properties of homogenous functions to bound the derivatives w.r.t. x. Indeed the manipulations 
are much easier here because there are no singularities. 



Case 1 -d/2 < s < 6>, s 7^ 1, 2, 3 . . . | Now t] = maxmin {9, \ [2kJ } = 6* by By virtue of homo- 



geneity 

\D"G(x)\ <fc,,|/3|(a+|x|)'^-l^l, /3>0, 
where ks^n — max max \D^G (x)| and so 

|a|— n |2:| — 1 



(1 - tf^ I {pf^G) [z -f tb)\ dt < / {a+\z + tfel)^"""^! dt. 

Jo 

If |/?| = 277 + 1 = 26* + 1 then 2s - |/3| = 2s - 26* - 1 < and consequently for [3^0 

(1 - t)'" I {D^G) (z + tb)\dt < (fc,j0|a2«"l'5|' 

so there is polynomial increase in z as required. 
When |/3| = 277 -Fl = 26* + 1 and z = 



Jo Jo 

Jo 



dt 



{a+\b\tf^~^' 
dt 



\f3\-2s 



a 

_ Km I 1 1,31 

_ ks,2e + l |l|2j7-I-1 

for all b. But we want a bound with the form j^j^'f+SiSG gp _ ^ when |6| < rc where re is 
arbitrary. 



Case 2 s ^ 1,2,3,.. .,6>- 1. 1 ByEH 77 = maxmin \_2k\} = 9. 
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Now G (x) = -^-^^ — (^a^ + |a;|^^ log (^a^ + and since any first order derivative of log |-| is a 

homogeneous function of order —1 there exist positive constants fcj, |^| and k'^ such that 



If 



Df'G{x)\ < (A:.,|;,||logN| + fc;|^|) N^^-I'^l, /3>0 
?| = 2s - 26* - 1 < and so for /3 ^ 

(l-i)"'|(i?'^G) {z + tb)\dt 

{ks.m ia+\z + tb\f'~^^^ |log {a+\z + tb\)\ + fc^j^i {a+\z + tb\) 
(fc,,l0|a2-l'5| |log {a+\z + tb\)\ + fc^i^ia^^-l^l) dt 
< a2^-l''lmax{fc,,|^|,fc;|^|} (^1 + ^ \log {a + \z + tb\)\dt 



2?/ + 1 = 26* + 1 then 2s 



< 



dt 



< 



(4.104) 



But 



|log {a+\z + tb\)\dt 



\ . ( \z + tb\ 
loga + log 1 + 







< ^ \loga\dt + J^ log(^l 

< ^ \loga\dt + J^ log(^l 



dt 

\z + tb[ 
a 

a 



dt 
dt 



= |loga|+log 1 



\z\ + \b\ 



(4.105) 



which implies the required polynomial increase w.r.t. z. Now substitute 14. 1051 into 14.10^ and set 2; = 
to get 



\b\ 



J^' (1 - tf^ I (D'^G) {tb)\dt < a2-l/3| (1 + |loga| + log (l + ^)) max {fc.,|/3| , fc^i^, } 16^' , 



when |6| < tq- We require a bound of the form 14. 8^ i.e. we need \f3\ =277 + 2Sg for some Sg > 0. But 
J| = 2?7 + 1 so (5g = 5 will suffice. 

Conclusion For any s > we can choose arbitrary re > and Sq — ■^^ 
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5.1 Introduction 
5.1.1 In brief 

Section 15.21 Some results from previous chapters. 

Section 15.31 Existence and uniqueness of the solution to the Exact smoothing problem. Derivation of 
several well-known identities. Some properties of the Exact smoother mapping. 

Section 15.41 We derive equations which express the reproducing kernel matrix in terms of the basis 
function matrix. 

Section 15.51 Matrices, vectors and bases derived from the semi-Riesz representer. 
Section 15.61 Matrix equations are derived for the Exact smoother. 

Section 15.71 Estimates the order of pointwise convergence of the Exact smoother to its data function 
on a bounded region. 



5.1.2 In more detail 

Given independent data |a;*-'-'}^j^ and dependent data {yi}f^i the Exact smoothing problem involves 

minimizing the functional p |/|^ Ji ^iLi |/(^*'*'') ~ over the semi-Hilhert space of continuous 
functions. Here p > is termed the smoothing parameter. The descriptor Exact is ours. We first prove 
the existence and uniqueness of a solution to this problem using the theory of basis functions and semi- 
Hilbert spaces generated by weight functions. Wc then derive orders for the pointwise convergence of the 
smoother to its data function as the density of the data increases. Each function in is considered a 
legitimate data function. 

Section 15.21 summarizes some of the theory needed from previous chapters. 

The weight function can be considered to have two parameters, the integer order parameter > 1 
and the smoothness parameter k > 0. Such a weight function will generate the spaces X^ and the basis 
functions of order 6. We next state the results we require from Chapter [?] where we studied the minimum 
scminorm interpolation problem. These results were adapted from Light and Wayne. These results start 
with the fundamental concept of a unisolvent set of points. Using a minimal unisolvent set we define the 
Lagrange polynomial interpolation operator V and Q = I — V as well as the unisolvency matrices and 
the Light norm which makes a reproducing kernel Hilbert space. Thus the Riesz representer of 
the evaluation functional f —f f {x) exists and can be expressed in terms of any basis function. In fact, 
the Riesz representer of the evaluation functional / f [x] is D^Rx for I7I < [kJ . In this document 

we follow Light and Wayne and instead of using the reproducing kernel we use the Riesz representer of 
the evaluation functional / — > / (x) which can be readily generalized to the evaluation of derivatives. 

We next present two types of matrix, the basis function matrix and the reproducing kernel matrix. The 
basis function, reproducing kernel and unisolvency matrices will be used to construct the block matrix 
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equations for the basis function smoother of tliis document. It wiU turn out that the Exact smoother 
will lie in the same finite dimensional basis function space Wg,x as the minimum scminorm interpolant. 

Here X = {a^''*''}^]^ denotes a unisolvent set of independent data points and G is a basis function. A 
function in Wg,x has the form 

JV 

^(/.,G(x-a;«)+p:0, eC, Pj^ = 0, pePe, (5.1) 

i=l 

where Px is a unisolvency matrix and G {x — x^'-*) is termed a data-translated basis function. Since the 
interpolant will be shown to be in Wg,x its finite-dimensionality allows the matrix equations to be derived 
for the 0j and the coefficients of a basis for Pg. The vector-valued evaluation operator £xf = (/ {^^^^)) 
is introduced. This operator and its adjoint under the Light norm will be fundamental to solving the 
Exact smoothing problem. 

In Section 15.31 we will use this mathematical machinery to define the Exact smoothing problem and 
then solve it using the Hilbert space technique of orthogonal projection based on the vector-valued 
evaluation operator £x and its adjoint. The Exact smoothing problem involves minimizing a functional 
over the space X^. More specifically, a special Hilbert space is constructed based on the smoothing 
functional and then the Exact smoothing problem is expressed as one of minimizing the distance between 
a point generated by the dependent data and a hyperplane generated by the independent data. Standard 
orthogonal projection results then yield the existence of a unique solution to the Exact smoothing problem 
which lies in the finite dimensional subspace Wg,x- 

Using the unisolvency matrix and the reproducing kernel matrix a block matrix equation is derived 
for the values of the Exact smoother on X, assuming the Riesz representer basis {R^[i)} for Wg,x- Then 
using this equation and relationships between the basis function matrix and the unisolvency matrix a 
block matrix equation is derived for the Exact smoother, assuming the data-translated basis function 
basis for Wg,x- The block matrix is constructed from a basis function matrix and a unisolvency matrix. 

The estimates for the order of pointwise convergence will use the Riesz representer and the operators 
which were used to solve the smoothing problem. We also employ a special lemma derived from the 
Lagrange interpolation theory from Light and Wayne [lOj . The dependent data y is generated using the 
data functions in the data space X^ so that y = £xf for some / G X^. Given a bounded open set fi, we 
are interested in the behavior of max^^^ \ui {x) — f {x)\ as some measure hx of the 'density' of the data 
points X increases. Following Light and Wayne [TU] we have used the measure hx = sup^^gQ dist (w, X). 
We show in Theorem 11911 that if the weight function has order and smoothness parameter k then we 
have the smoother error estimate 

\se{x)- fd{x)\<\fd\^ g{l + K'^^g)(^-^[cn,ehxT^''' + Vn~p). x gU, (5.2) 

where rj = min {e, i [2kJ } and some Sg > 0. Here cg, co.e, K'^ g are constants independent of X and 
when p = we have an estimate for the interpolant derived in Chapter |4l This result is illustrated using 
the radial thin-plate and surface thin-plate splines. 

Unfortunately, for given hx, N = \X\ can be arbitrarily large so to obtain an order of pointwise 
convergence a relationship between N and hx is obtained by numerically constructing several X in 
[—1.5,1.5] C using a uniform statistical distribution and then using a least squares fit to obtain 
hx — 3.09A^^° *^. Substituting for N in 15.21 and minimizing the right side using p we show that given 



hx^ there is a sequence p^. such that si'^^ (x) — fd (x) < Ci {hxkY'^"'^ — > 0. We say the order 

of convergence is at least (hx^)^^^'^ ■ 

For special data functions that are linear combinations of Riesz representers Rx'. a doubled order of 
convergence of 2ri -\- 2Sg is demonstrated. 

I have not included the results of any numerical experiments concerning the smoother error estimates 
derived in this chapter. 



\ri+SG 



5.2 Preparation 

We will require the following results from previous chapters concerning the data spaces X^, the Riesz 
representer and the spaces Wg,x- 
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5.2.1 The data spaces 

Summary 161 Suppose the weight function w has property W2. If f £ then f £ Lj^^ (W^\0) and 
we can define the function fp '■ K"* — > C a.e. by: f p = f on W^\{). Further: 

1. The seminorm M .22\ of X?^. satisfies fTheorem \25]) 

I w\-f\fFf^\f\l^,. (5.3) 

2. An alternative definition of X^ is (Theorem \25]) : 

^:-{/e^':r/eLL*/ H=0; y'u;|.r|/^|^<oo|. (5.4) 

Note that the condition f £ L]^^ (R''\0) is implied by £ L\^^ for all \a\ — 9. 

3. The functional \ g is a seminorm and null|-|^ g = Pg. Also PH X^ = Pg (Theorem\25\) . 
4- X^ is complete in the seminorm sense for all orders > 1 (Theorem \37\ l. 

5. Suppose w also has property W3 for order and k. Then X^ C C'^p^'' (Theorem\40^- 

5.2.2 The Riesz representer of u ^ u (x) 
This summary combines results from Section [ 



Summary 162 Properties of the Riesz representer of the evaluation functional u ~> u {x) 
onXi: 

1. Given any minimal 6 -unisolvent set of points A = {a^}*!]^ we endow the semi-Hilbert space X^ 
with the Light inner product (•, •)^ g defined using the cardinal basis {h}f^i that corresponds to A. 
Then the representer is given by \4.35\ where G is any basis function of order 9 generated by the 
weight function w with properties W2 and W3 for order 9. 

2. For allu£ Xl,u (x) = {u, Rx)^^g- 

3. Rx is unique and is independent of the basis function used to define it. 



4. Rx{y) = Ry{x). 

5. Rx (ai) = k (x). 

6. Qu (x) = {u, Rx)y,fi when u £ X^,. 

7. VRx^ Eh{x)k. 

i=l 

5.2.3 The basis function spaces Wg,x and Wg,x 

The importance of the finite dimensional spaces Wg,x and Wg.x is that they contain the solutions to 
the variational interpolation and smoothing problems studied in this document. 

Definition 163 (Copy of Definition ] 1 3(j\ } The basis function spaces Wq.x and Wq.x 

Suppose the weight function w has properties W2 and W3 for order 9 > 1 and n. Then the basis 
distributions of order 9 are continuous functions and we let G be a basis function. Let X — jx'*-'}^ be 
a 9-unisolvent set of distinct points in M'' and set AI = dim Pg. Next choose a real-valued basis {Pj}'^^^ 
of Pg and calculate the unisolvency matrix Px — {pj (a;^*'')). We can now define 

Wg,x = jll (x - : {v,) £ and P^v - o| , 
Wg,x = Wg,x+P0- 
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Summary 164 From Section \4-7\ we know that set-wise: 

1- Wg,x is independent of the basis function of order 9 used to define it (Theorem \13'2\) . 

2- Wg,x o-nd Wg,x o,re independent of the basis used to define Pg (Theorem \181\) . 

3- Wg.x is independent of the ordering of the points in X (Theorem \132fl . 

The next theorem restates more results from Section HTZl 

Remark 165 Summary 166 The spaces Wg,x cind Wg,x have the following properties: from Theo- 
rem \134\ 

N J 

1- Iffv (x) = E VkG {x - a;^^)) then \f,\l , = (2^)^ v^Gx,xv. 
fe=i 

2. Gx,x is conditionally positive definite on null i.e. when -Pjw — and v we have v'^Gx,xv > 
0. 

3. Wg.x = Wg,x © Pe, dim W^g,x iV - M and dimT4^G.x = ^• 
I Xl = Wg,x © W^G,x where 

Wg,x = [ueX^:u (x^^)) = for all x^^^ e x| . 

From Corollarv \135\ 
5. If {Pj}^Li is basis for Pg then the representation 



N M 



w. 



G,x = lj2'^^^{-~^^'^)+J2l^3Pr-Pxa^0, a = a,,l3^eC\, (5.5) 

is unique in terms of ai and (3j . 
From Corollary \ni\ 

6. Suppose A <Z X is a minimal unisolvent set and suppose Rx is the Riesz representer of the functional 
f ^ f {x) w.r.t. the Light norm, both being defined using A. Then Wg,x h.o,s basis {R^a) '■ x^^"^ ^ A} 
and Wg,x has basis {Rxii)}f=i- 

5.3 Solution of the Exact smoothing problem and its properties 

The Exact smoothing problem involves minimizing a functional over the space of continuous functions 
Xf^. The fimctional is constructed using a smoothing parameter p > 0, the seminorm \-\^ g of X^ and 

a set of distinct, scattered data points { (a^^*^ j^^, 2;^'^ G W'- and yi G K. As with the interpolation 
problem we require the x^*-' to be distinct. The data will sometimes be specified using the notation [X, y] 

where X — {x^^^^^i is termed the independent data and y — {j/i}^]^ is termed the dependent data. 
The functional to be minimized is 

N 



^e[/]-H/l^,, + ^E|/(x«)-2/.f , fexl (5.6) 



The Exact smoothing problem is now stated as: 



5.3 Solution of the Exact smoothing problem and its properties 
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Definition 167 The Exact smoothing problem and the Exact smoother 

Minimize the Exact smoothing functional Je on the space . 
A solution to this problem will be called an Exact smoother of the data [X,y]. 

The first component p\f\^g of the functional can be regarded as a global smoothing component and 
the second component as the localizing least squares component. 

It is clear that when p = any interpolant of the data minimizes the Exact smoother functional. Thus, 
from part 4 Theorem 1 1 661 the set of solutions is uj + Wq where uj is the minimal seminorm interpolant 
studied in Chapter [H In Remark 11841 we will note that as p —^ the matrix equation representing the 
solution to this problem becomes that of the minimal norm interpolation problem so the limit "seeks 
out" one particular interpolant. 



5.3.1 Existence, uniqueness and formulas for the smoother 

Using the technique of orthogonal projection it will be shown below that a solution to the smoothing 
problem exists and is unique. The proof will be carried out within a Hilbert space framework by for- 
mulating the smoothing functional in terms of a special inner product on the Hilbert product space 
V = (g) C^. To this end I will introduce the following definitions: 

Definition 168 For order 9 > 1: 

1. Suppose p > 0. Let V ~ X^ (g) be the Hilbert product space with inner product 

((U1,M2) , {vi,V2))v = P{ui,Vl)^^g + (u2,W2)c« , 



and\\f\\l = {fj\ 



Let Cx '■ X'^ V be defined by Cxf — {j,£xf^ where £x is the 



evaluation operator of Definition 



Remark 169 The smoothing functional can be expressed in terms of Cx and the data as follows: set 
<; = (0, y) G where y = (jji) is the dependent data given in the Exact smoothing problem. Then for 



X 



f-,\\l = \\[f,£xf)-{0,y)\\l = \\{f,£xf~y) 



p\fL., 

Jeif] 



1 

N 



£xf - y 



The operator Cx '■ X^ V and its adjoint C*^ : V X^ have the following properties: 

Theorem 170 Suppose X is a 6-unisolvent set and A d X is a minimal unisolvent set. Use A to define 
the Light norm ||-||^ g and the Lagrange interpolation operator V . Then when p > 0: 

1. and ||/||^ q are equivalent norms on X^. 

2. Cx : X^ ~t V is continuous and 1-1. 

3. C*x ■ V — > X^^ is continuous w.r.t. the Light norm and if u = {U1U2) G V then 

C*xu = pQui + j^£*xU2, 

with range C*x — X^ . 

4. C\Cx ■.Xi-.Xi and 

C*xCx ^pQ + —£*x£x- 



5. C\Cx is 1-1 on X^. Also, {C\Cx) ^ is continuous on va.TigeC\Cx- 



122 



5. The Exact smoother and its convergence to the data function 



Proof. Part 1 From the definition of Lx , if / G X 

2 



l-Cx/lly = 



£xf 



< 



constWfW^g, 



since £x '■ Xt, 



pN 



is continuous by part 1 of Theorem 11391 Also 

-1 



l/ll. 



i/i: 



£Af 



CM 



1 



N 



mm < p 



P\f\l,e + 



£xf 



since p > 0. 

Part 2 Part 1 implies £x is continuous and that £x is 1-1 is clear from its definition. 

Part 3 Since Cx is a continuous operator the adjoint : V — s- X^, exists and is continuous. Further, 
if / G and u = (U1.M2) G V then by the properties of the Light norm given in Theorem II 161 

{£xf,u)y = ,(^1,^2))^ =P {f,ui)^g + ^ {£xf,U2 

= P (/, Qui)^^g + ^ [f; £*xU2 



= ( f,pQui + j^£*x^2 



Hence C*x'u = pQui + j^£*^u2- 



Part 4 



C*xCxf = pQ {(Cxf\) + ((/:x/)2) = pQf + ^^x^x/. 



Part 5 Suppose C\Cxf = 0. Then = {£*^£x f, f)^^g = {Cxf,Cxf)^^e = ll^^/llLe so that 
Lxf = and / = since Cx is 1-1. Hence C.*x^x is 1-1. 

Since C-^Cx is continuous it has closed range. By the bounded inverse theorem {C^Cx)"^ is also 
continuous on v&nge C*xCx- ■ 

Using the Hilbert space technique of orthogonal projection the next theorem shows that when p > 
the Exact smoothing problem of Definition 11671 has a unique solution in X^. 

Theorem 171 Fix y G M.^ and let — {0,y) E V . Then for p > there exists a unique function Sg G X^ 
which solves the Exact smoothing problem with data [X,y]. This solution has the following properties: 

1. WCxSe -<.\\v< W^xf - 4v V all fexl- K}. 

2. {Cxse - Cx-s, ~ Cxf )v = for all / G X« . 

3. \\CxSe - ^lly + WCxSe - Cxffy = W^X f - for all f G X^. 

This equality is equivalent to that of part 2. 

4. Se^ jj {C*xCxy^£*xV- 

5. Since > 1, p E Pg implies p = {C*xCx)~^ £*x£xP- We say the Exact smoother preserves 
polynomials up to order 0. 

Proof. Parts 1,2,3 Since Lx is continuous, we know that the hyperspace Lx (Xf,) is closed and hence 
that the translated hyperspace Lx (X^) — <r is also closed. But from the remark following Definition 
11681 [/] = \\Lxf — "^lly and the Exact smoothing problem becomes minimize \\Lxf — ^\\v O'^sr Xf^,. 
Thus by a well-known orthogonal projection result concerning the distance between a point and a closed 
subspace, there exists a unique element of Lx{X^) — ^, call it LxSe — ^ such that Sg satisfies parts 1, 2 
and 3 of this theorem. 
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Part 4 Using the equation proved in part 2 

= [CxSe - <r, CxSe - Cxf)v ^ {CxSe - ^, {Se ^ f))v ^ {^*X i^XSe - , Se " f)^^g , 

for aU f eXl. Thus 

C*x {CxSe -0=0, (5.7) 
and therefore ^ 

C*xCxSe = C*x<; = C*x iO,y) = jj^xV- 

But by part 5 of Theorem 1 1701 C*xCx is one-to-one and so Sg = {■^*x^x) ^ ^xV- 
Part 5 Substituting y — £xP into the result proved in the previous part gives 

Se — {C*xCx) ^ Sx^xP, or equivalently N C*xCxSe — £*x£xP- But from part 4 of Theorem 11701 
C*xCx - pQ = jj£*x£x- 

Substituting this as an expression for Ex^x into the last equation we get 

NCxCxSe - N [C*xCxP - pQp) = NC*xCxP, 
since Qp — (I — V) p — 0. Finally, by part 5 of Theorem 1 170| Cx^x is one-to-one and hence Se — P- 



5.3.2 Various identities 

The last theorem showed that the Exact smoothing problem has a unique minimizer in . In the next 
corollary we prove that the smoother lies in the space Wg,x introduced in Subsection 15.2.31 In the next 
two corollaries we will also prove several well-known identities which involve all the data points. These 
identities relate the Hilbert space properties and the pointwise properties of the data and the Exact 
smoother. 

Corollary 172 Suppose X — 9-unisolvent so that X contains a minimal unisolvent subset 

A. Use this subset to define the operators V , Q and the Light norm. Then the unique solution Se € X^ 
of the Exact .smoothing problem with data [X, y] has the following properties: 



1. Sg e Wg,x arid Se — VSe 

2. For all f e X^ we have 

N 



■W-p^*X [^XSe 



P\Se 



Vk 



k=l 



p\i\: 



1 ^ 



1 ^ 



(fc) 



k=l 



Vk 



(5.8) 



or 



Je[Se]+p\Se- f\l 



1 ^ 



fc=i 



(5.9) 



3. Pi {{se)x - y) - 0. 

Proof. Part 1 



Q = C*x {CxSe - <;) = C*xCxSe 



1 

N 



£*XV = pQSe 



PSe 



1 

pVs 



£x£xSe - J^^XV 
£xSe " 



so that 



VSe 
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and Se e Wg,x by part 2 of Theorem [T^ 
Part 2 By part 3 of Theorem [ITT] 

WCxSe " ^lly + WCxSe - Cx/fy = \\Cx f - , / G 

Using Remark 11691 and the definition of Cx this equation becomes 



I |2 , 1 



N 



£xSe - V 



2 1 ~ 2 2 1 



£xf - V 



for aU / G Xf, and y G M^, which proves this part. 
Part 3 If p e Pe , then from part 1 



Np 



= 0. 



But 



N 



SO by part 2 of TheoremlTOll ((se)^ - y) = 0. ■ 

We next prove some standard results which express the smoothing functional and the seminorm of the 
smoother in terms of the dependent data and the values taken by the smoother on the independent data. 



Corollary 173 Suppose {(2;^''^ J/fc) is the data to be smoothed. Then the Exact smoothing function 
Se has the following properties: 



1. For allp € Pe 



1 ^ 

fc=l 



, N N 



fc=i 



Af 2 ^ 

k=l k=l 



AT 



fc=i 



fc=l 



AT 



Je[s,] = iReE (2/fe-Se(a:«))y^. 



fc=i 



Proof. Part 1 Substitute f = p E Pg in the equation of part 2 of CoroUarv 11721 and use the fact that 
\9+P\uj.e = \9L.9 when g e X^. 



Part 2 Substitute / = in the equation of part 2 of CoroUarv 1 1721 
Part 3 Substitute the expansion 
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fc=l 



N 



N 



Vk 



in part 2 of Corollary 1 1721 so that 

fe=l fc=l 
' " fc=i ^ 

^E 

fe=i 

fe=i fc=i 
fc=i 

w _ 



2 1 



TV 



(fe) 



k=l 



2 Res 



2 

TV' 



2 

N 



k=l 
N 



Part 4 Substitute the formula for |se|^, g of part 3 into the definition of Je [se] to get 

1 ^ 2 

Je [Se] = P\Se\l^g + ]^ E (^^''0 ^ 

k=l 

, Af 



- 2 Re s, 



fc=i ^ 

^Ei»i'->E»e(»'") 

fe=l /c=l 

1 ^ 



2/fc + l2/fe| 



N 



Vk 



fc=l 



5. 5". 3 Data functions and the Exact smoother mapping 

Part 4 of Theorem 11711 allows us to define the mapping between a data function and its corresponding 
Exact smoother. We call this the Exact smoother mapping: 

Definition 174 Data functions and the Exact smoother mapping 

Given an independent data set X , we shall assume that each member of can act as a legitimate data 
function f and generate the data vector £xf- By part 5 of Theorem \170\ the linear operator {C*xCx) ^ 
exists and is continuous. Thus part 4 of Theorem \171\ enables us to define the continuous linear mapping 



Wg,x from the data functions to the corresponding unique Exact smoother by 



S'xf^i^i^x^x)-'£*x£xf, /ex 



N 



(5.10) 



We will now prove some properties of the operator C*xCx which in turn will be used to prove some 
basic properties of the Exact smoother mapping. 
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Theorem 175 Properties of L\Cx and S\ 

When p > the composition C'xCx '■ is a homeomorphism and C*x^x ■ Wg,x Wg,x is 

also a homeomorphism. Regarding the properties ofSx-' 

S'xf^f-p{C*xCxr'Qf, feXl (5.11) 
and the operator is continuous. Further: 

1- \Sxf\w,e ^ \ f\w,e \{I - 5%) f\^g < \f\^g when f e X^ i.e. S% and I ~ S% are contractions 
in the seminorm sense. 

2. S3,f ^ f iff f e Pe. 

3. S'x:Xl-> Wg^x is onto and null 5^ = W^^. 

4-. The adjoint of the Exact smoother w.r.t. the Light norm is given by: 

iS'xT 9 = ^^*x^x {C*xCx)-' 9 = 9- PQ iC*xCxr' .9, 9 e Xl 

5. Sx is self-adjoint iff X is a minimal unisolvent set iff Sx = V i.e. the Lagrange polynomial 
interpolation function\4.1\ 



Proof. Suppose / e X^ and let Sg = '^xf- From part 5 of Theorem 11701 is is known that C*xCx is 
1-1. From part 4 of Theorem [HIl C*xCxSe = jr^*x^xf and from part 4 of Theorem [I7D1 C*x£xf = 
pQf + jjEx^xf so that C*xCxf = pQf + C*xCxSe- Clearly this equation implies equation 15 . Ill and also 

Qf = jr*xCx ( , feXl (5.12) 



This last equation proves Q (X^) C CJ'xC.x {X-x,^ and if we can show that Pq C CJ'xC.x [X^^ then 
it follows that C*xCx {X^^ = Xf^ and so by the open mapping theorem C*xCx is a homeomorphism. 
Suppose p £ Pe and for some / G X^ 

P^C*xCxf = pQf + l^£*x£xf. (5.13) 

By Theorem 11391 ^x^x '■ X^ Wg.x is onto and so it follows that a solution g to -^£x£x9 = P 
exists. Now try a solution to 15.131 of the form f — g + u so that p = C*xCx {g + u) and u must satisfy 

Cx^xu = P — ^*x^x9 = P — (^pQg + Ti^x^xg^ = —pQg £ 2(^-f>)- But we already know that 
Q (Xf,) C ^*x^x (X^) so a there exists u such that C*xCxu = —pQg and hence a solution f = g + u to 
15.131 Consequently Pg C ^*x^x (X^) and C*xCx ■ X^ X^ is a homeomorphism. 

By part 3 of Theorem [TH Wg.x = Wg.x^Pq and hence V (Wg.x) = Pe, Wg.x = Q {WG,x)®Pe and 



Q{Wg,x) = Wg.x- Thus [HO] implies Wg.x = Q(W^g,x) C C*xCx (Wg.x) and so C*xCx (Wg.x) 
Wg.x- The open mapping theorem then implies that C*xCx ■ Wg.x — > Wg.x is a homeomorphism. 



Part 1 In equation 15.81 let / be the data function and note that the data function interpolates the 
data. 

Part 2 Since C*xCx is a homeomorphism, from[5ll]5^/ = / iff {C*xCxy^ Q/ = iff Q/ = iff 
f E Pe, where the last implication follows from part 4 of Theorem 11021 

Part 3 By part 6 of Theorem [133 5^/ = iff Sx^xf iff / G W^x- 

From [STTOl Sxf — {£x^x)~^ £x^x f and since we know from earlier in the proof that S'x^x ■ 

Xw ~^ Wg.x and {£*xCx)~^ '■ Wg.x Wg.x are both onto we have our result. 

Part 4 A standard Hilbert space result is that if /C is a homeomorphism then (/C^^)* = (/C*)^^. 

Thus, since Sx^x and C*xCx are self-adjoint and by Theorem 1 1161 Q is self-adjoint, taking the adjoint 
of equations 15.111 and l5.12l easilv yields the claimed formulas for (5^)*. 

Part 5 Starting with the formulas of 15.111 and part 4 we have the equivalences: 
{Sj,r=S<x iff Q{£*x^xy\f = i^*x^xy'Qf, f^K, 

iff v{c*xCxy' f = {c*xCxy'vf, fexi 
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Since C.\Cx ■ is a homeomorphism, if we set g ~ [C^Cx)^"^ f then 

(S^xT = Sj, iff C*xCxVg = VCxCxg, g e 
Further, by Theorem [1701 C*xCx = pQ+ ^^^^x and since VQ = 

(5^)* = S'x iff ^i^xT'.g = vrx^xg, g e 

Recall the properties of the Riesz representer given in Subsection 14.5.31 Next suppose X = 
{'^^'^^ }fc— 1 i^ minimally unisolvent and that the minimal unisolvent set A d X was used to construct 

the smoother, V, Q etc. Then VS^Sxg e Pe and so £*x£xVg ^ Vg + J2 ("^ff) i^^''') ^xW ^ Pe 

x(Oex\A 

with the independence of the functions {Rx(i)}iLi implying that (Vg) (x*^*^) — when e X\A and 
g e Xf,. Therefore, given x^^^ G we have p (a;'*^) = when p £ Pg which is a contradiction. We 

conclude that (Sx)* Sx or X is minimally unisolvent. 

If X is a minimal unisolvent set and / is a data function then Vf (x''^^) — f (x''^^) and Vf G Pe so 
that the Exact smoother functional satisfies Je [Vf] — and thus Sxf ~ Vf i.e. Sx = V. Finally, if 
Sx = V then Sx is self-adjoint w.r.t. the Light norm by Theorem 11161 ■ 



5.4 Expressing Rx^x in terms of Gx,x 

In this section we will derive equations expressing the reproducing kernel matrix in terms of the basis 
function matrix. I start with some notation: 

Definition 176 Matrices and vectors derived from the Riesz representer R^ and the basis 
function G. 

IfX^ {a;('=)} C R'^ and y eW^ then Ry^x = {RxU) {v)) is a row vector and Gy^x — {y ~ x*-^')) is 
a row vector. 

Also Rx,y — {Ry (2^'*'*)) column vector and Gx,y — {G (a;'*' — y)) is a column vector. 

Using the notation of Definition ll76l this theorem derives some of the relationships between the matrices 
Rx,x and Gx,x- 

Theorem 177 Suppose A is any minimal unisolvent set and let the corresponding cardinal basis be 
• Define the Riesz representer R^ using A and . Then for any finite set X C K*^ and y G 

Ry^x = i2TT)-i (^Gy,x ~T{yf Ga,x ~ Gy^ALl +Tiyf Ga,aLI) +T{yf L'^. 

The reproducing kernel matrix Rx.x — {RxO) {^^^^)) '^'^'^ basis function matrix Gx,x = 
(G (x^^' — a;*^^^)) are related by the formulas 

Rx,x = (27r) 2 (^Gx.x ~ LxGa,x ~ Gx.aLx + LxGa,aL^) + LxLx, (5.14) 

and 

Rx.x - (2^)"^ (In - Lx-o) Gx.x {In - Lx.of + LxL^x. (5-15) 
where Lx = (Zj(x(*))) and Lx-a = {Lx On,n-ai)- 
Proof. From l4735l 

M M 

(27r)^ Rx {y)^G{y~x)~Y. ^ (^^'^ ^ ^) " E ^ " ^^'0 + 

3=1 i=l 

M M 

+ ^ I, {y) G (x(^) - x(^)) /. (x) + {2^)i ^ l,{x)l, (y) , 

or in the notation introduced in Definition 1 1761 

Rx{y) = (2tt)-^ (g {y - x) -T{yf Ga,x - GyJix) +T{yf GAjix)) +l{yfT{x), 
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Now Ry,x is tire row vector {R^u) {y)) and Lx = {ij (2:'*^)) so 

Ry^x = i2Tryi (Cy^x ~T{yf Ga,x ~ Gy^AL^ +T{yf Ga,aLI) +l{yf L^, 
and hence, since Lx;0 — [Lx On,n-m), 
Rx,x = {Rx(^),x) 

= (27:)-^ iG^i.Kx-^{^'^'^) Ga^x - G,(„^^i5 +r(a;«) G^.A^xj +T[x^'^) 

— (27r) 2 {Gx,x — LxGa.x — Gx,aLx + LxGa,aLx) + LxLx 

~ (27r) 2 [Gx,x — LxfiGx.x — Gx,xL^fl + LxflGx.xL^-o) + Lx-oLx-o 

= (27r) 2 (/jy _ £x;o) (-^tv — Lx-o)^ + Lx^lJ^.q. 

■ 

5.5 Matrices, vectors and bases derived from the semi-Riesz representer 

The semi-Riesz representer r^ = QRx was introduced in Chapter |4] where r^ (x) was used to estimate 
the convergence of the interpolant. In this document r^ (x) will be used to estimate the convergence of 
the Exact smoother. Some basis properties of r^ were proved in Theorem II 251 and we will need these to 
prove the following result: 

Corollary 178 Suppose X — {x^"^^} i—i unisolvent and A — {oi}^^ is a minimal unisolvent subset. 
If fx is defined using this set then the functions : x^'' ^ A} are independent and form a basis for 

Wg,x- 

Proof. Firstly, by part 2 Theorem 11251 ^at = for i = Next we prove independence. If 

J2 Pifxii) = then Q J2 PiRxH) = so that J2 Pi^^xd') — T-' J2 Pi^xi^) S Pg. By part 6 of 

x(O^A xWf^A 

Summary [Ml PtRx('> ^ Wg.x- But by part 3 of Summary [Ml Wg.x = Wg,x © Pe so all the 

x(i)f^A 

/3j are zero. Also by part 3 of Summary 11661 Wg,x has dimension N — M and so the N — M functions 
{r^(i) : x^^^ ^ a} form a basis. ■ 

Definition 179 Matrices and vectors derived from rx 

If X = {x'^'"'^} C M'' and y e R*^ then rx,x — {rxU) {^^^^)) ^ ^x.y — {fy (2;''*^)) is a column vector and 
fy.x = [fxif) iy)) is a row vector. 

Theorem 180 Suppose X — {2;'-*^}^^^ is unisolvent and A is a minimal unisolvent subset with cardinal 
basis {li}i^i. Then if rx — QRx is defined using A we have: 

1. rx,y = Rx,y - Lxl iy). 

2. rx,x — Rx,x — LxL'^. 

3. The matrix rA^.A" is positive definite, regular and Hermitian where A'^ = X\A. 

Proof. Parts 1 and 2 The definition of the cardinal unisolvency matrix is Lx — {ij (a^*^*'')) and by part 

M 

6 Theorem 11251 Ry ~ fy + 'Yl h iu) h- Parts 1 and 2 then follow easily from the definitions of rx,y and 

i=i 

rx,x- 

Part 3 From Theorem 11251 r^y) (x'*') — (r^u-) ,r^(i-))^ g and r^o) (aj = for at e A. Now let (•, •)^ g 
be the Light inner product 1 1.1 21 (u, v)^ g = (w, u)^ e+ ''^ i'^i) ^ i^i) constructed using A. It now follows 

i=l 

that r^(j) (cc'-*-') = (r^u) , r^(i) )^ g for all i and j, and so the matrix rA^^A" = {I'xU'i {^^^^)) is a Gram matrix 
and the properties stated in this theorem are well-known properties of Gram matrices. ■ 
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5.6 Matrix equations for the Exact smoother 

In Corollarv ll72l it was shown that the unique solution of the Exact smoothing problem of the data [X, y] 
lies in the finite dimensional space Wg,x which has a unique representation given by [53] i.e. 

N M 



i=i j=i 

where X = {a;'*^}^^^. The goal of this section is to derive a matrix equation for the coefficients ai,(3j 
of the basis functions of the space Wg,x- We start by deriving a (singular) matrix equation for the 
values taken by the Exact smoother at its independent data points X. Now recall the notation fx for 
£xf introduced in Definition 11381 

Theorem 181 Let X = \^x^^^}._-^ be a unisolvent set of independent data with a minimally unisolvent 

subset A. Construct Rx using A and its cardinal basis {li}^Li! '^'^^ denote the Exact smoother of the data 
[X, y] by s. Then 

{Np {In - Lx:o) + Rx.x) sx = Rx.xy, (5.16) 

and 

Ll{sx-y)^0, (5.17) 

where Lx = (ij (x*-*-*)), Lx-o = {Lx On.n-m) md Rx.x = (-^^(j) l^;*-*^)) is the reproducing kernel 
matrix. 

Proof. From parts 4 and 8 of Theorem 11391 we have £x£xP — Rx.xP and Ex'Ps = LxSas. From part 
1 of Corollary 1 1721 we have s = Vs — -^^x (^^xs — y^ ■ Applying £x to the last equation to get 

Sx = SxVs - -^£x£*x [sx -y) ^ Lx£as - -^Rx,x {sx - v) 
IN p IN p 

= Lx-qSx — -T^Rx.xSx + -irrRx.xy, 
Np Np 

or on rearranging 

{Np {In - Lx-o) + Rx.x) sx = Rx.xy, 

which is the desired matrix equation in £xs. Finallv r5. 17l follows from part 3 Corollarv ll72l and equation 
|13of part 3 Theorem [inil ■ 

CoroUarv 11721 established that the Exact smoother has a unique solution in the finite dimensional space 
Wg,x ■ By Definition 11301 Wg,x is independent of the basis function G, the order of the points in X and 
the basis of Pe used to define Px- The next theorem derives the corresponding matrix equation for the 
coefficients of the basis functions. This matrix equation is deduced using the relationships between the 
reproducing kernel matrix Rx,x and the basis function matrix Gx.x derived in Theorem 1 1771 However, 
to prove the next (well-known) result we need Lemma 11431 from Chapter |4l 

Lemma 182 (Lemma \143^ Let B be a complex-valued matrix and C be a real-valued matrix. Suppose the 
' B C 



block matrix [ ^ j is square and that for complex vectors z 



1. Then the equation 



z Bz = and C z ^ implies z — 0. (5.18) 



B C \ f u \ _ f 
C^ O ) \ V )- \ {) 



implies u — Q and v G nuUC. 
2. If in addition to \5.18\ null C — {0}, then the block matrix is regular. 
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Theorem 183 Suppose [X, y] is the data for the Exact smoothing problem of Definition \167\ where 

X — is 9-unisolvent and y = {yi}f^i- Then given a real-valued basis {pj}^Li for Pg and a basis 

function G of order 9, the Exact smoothing problem has a unique solution s G Wg,x of the form 



N M 



=5]«.G(a:-x«) +^/3^-p,(x), (5.19) 



where the coefficients v — (vi) G and (3 — {f3j) E satisfy the Exact smoothing matrix 
equation 

( {2t:)^ NplN + Gx,x Px \ ( \ ^ ( V 

\Pl Om \P J \0 



(5.20) 



Here Px — (pj (2;^*'')) a unisolvency matrix and Gx.x = (G (x^*) — a;^-'-')) is the basis function 
matrix. 

The matrix equation \5.20\ is independent of the ordering of the data [X, y] . 

Finally, the Exact smoothing matrix is regular and positive definite but in general it is not Hermitian. 
However, there always exists a basis function such that the Exact smoothing matrix is Hermitian. 

Proof. Step 1 Since X = {x^^^]'^-^ is 6'-unisolvcnt there exists a minimal unisolvent subset, say Xi. 
Assume that Xi — {a;^')}^^^^. Now construct V, Q, the Light norm and the Riesz representer Rx using 

Xi and its cardinal basis {li}f^i for Pg. 

Initially we will derive the Exact smoother matrix equation using the cardinal basis associated with 
Xi so that Px ~ Ex ~ {ij (2^^'^))- Consequently, by the interpolation result Theorem 11441 of Chapter HI 
for given dependent data sx — (s there exist unique vectors v and 7 such that 

Gx,x Lx \ f V \ _ f Sx 

■T 
'X 



Lx Om J \ 1 J V 



This matrix equation is equivalent to the two equations 

Gx,xv + Lxi = sx (5.21) 
L'^v = 0. (5.22) 

Multiplying equation 15.211 bv NpR^^ {In ~ Lx-a) + In and using equation l5. 161 gives 

(NpR-x\ {In - Lx;o) + In) {Gx,xv + Lxl) = (NpRl^^ {In - Lx.o) + In) sx = y. 
From part 3 Theorem 11051 {In — Lx-o) Lx = O so the last equation simplifies to 

NpRx^x {In - Lx-fl) Gx^xv + Gx^xv + Lxi = y. (5.23) 

We now require an equation that expresses Rx,x in terms of Gx,x- To this end we use equation 15. 151 
namely 

Rx,x — (27r) 2 {In — Lx-o) Gx,x {In — Lx-a)^ + LxLjr. 
Multiplying this equation on the left by R^x ^"^^ right, and noting that = 0, yields 

V ^ {2Tiy'^ R-^^x{In -Lxfi)Gx,x{lN-Lx-of v + Rx]xLxL^xV 
= {27:)-^ R-^^xilN -Lx-fl)Gx,xv, 

and thus 1 5 . 231 reduces to 

({2^)^ NplN + Gx,x)v + Lxi^y. (5.24) 
constrained by equation 15.221 i.e. L'^v — 0. 

Since Px = {Pj {xi)) and Lx — {Ij {xi)), where {pj} and {Ij} are both real- valued bases for Pg, it 
follows from part 3 Theorem 1 1 041 that there exists a regular matrix C such that Lx — PxC. Substituting 
for Lx in 15.241 and 15.221 and then setting (3 = C7 yields the Exact smoothing matrix equation 15.201 
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Step 2 We now show that re-ordering the data does not change the equation for the smoother. Re- 
ordering a vector involves a permutation tt. Re-ordering a column vector involves left-multiplication by 
the permutation matrix 11 and re-ordering a row vector involves right-multiplication by the transpose of 
the permutation matrix. Thus the new matrix equation is 

i27r)i NplN + G^^x)Mx) P.{x) \ ( \ - ( \ 

Plix) Om )[p'J-[o )■ 

Thus G^(x),7r(x) — nGx.xII^, P-^ix) = and tt {y) = Hy, or since IIIl'^ = /jy. Under the last set 

of transformations the Exact smoothing matrix equation becomes 

((27r)^ NpmF + nGx.^n^) v' + UPxf-i' = Hy, Px^Fv' = 0, 

or 

((2^) i Np + Gx,x) n^«' + PxP' = y, Px^^v' = 0, (5.25) 
and so the matrix equation is unchanged by re-ordering the data. 

Step 3 The next step is to show that the Exact smoothing matrix is regular. To do this we use Lemma 
[HHwith B = (27r)^ NpiN + Gx,x, C = Px, and then show that z'^ ((27r)^ Npl^ + Gx,x) z = Q and 
P^z = implies z = 0. Now 

((27r)^ Nplx + Gx,x) z = (27r)^ z'^NplNZ + z'^Gx,xz 

= {2Tr)^ Np\z\^ + z'^Gx,xz. 

But by part 2 Theorem 1 1661 Gx,x is conditionally positive definite on nuUPj i.e. z G nuUPj implies 
that z^Gx,x'z > except when z = 0. Thus z e nuUP^ and z"^ ^(27r)^ Npl^ + Gx,x^ z = implies 
z = and the Approximate smoother matrix is regular. 

Finally, part 2 Theorem [92] from Chapter [3] allows the basis function G to be chosen so that G {x) — 
G {~x) and this implies Gx.x is Hermitian. ■ 

Remark 184 

1. When p = the matrix equation for the Exact smoother becomes the matrix equation for the 
minimal norm interpolant - see Theorem \144\ 

2. The matrix V5.2U\ is N x N i.e. its size depends on the number of data points, so this algorithm is 
not scalable i.e. the time of execution is not linearly dependent on the number of data points. The 
Approximate smoother, which overcomes this problem, will be derived in Chapter\^ 

The basis function form of the Exact smoother matrix equation can also be derived using Lagrange 
multipliers. The next result shows that the algebra can be significantly simplified by assuming the basis 
function is real valued. 

Corollary 185 // the dependent data y is real-valued and the basis function is real-valued, then the Exact 
smoother is real-valued. Also, the smoother lies in the subspace of Wg,x defined using the real scalars 
instead of the complex scalars. 

Proof. By Theorem 1 1771 if the basis function G is real- valued then the reproducing kernel matrix Rx.x 
is real- valued. Hence, since the cardinal unisolvency matrix Lx is real- valued, equations 15.191 and 15.201 
imply that the smoother is real-valued. ■ 



5.7 Convergence to the data function - smoother error 

In this section we will prove that in the sense of Corollary 11901 below the Exact smoother converges 
uniformly pointwise to its data function on a bounded set. The rates of convergence are shown to be the 
same as those obtained for the minimal seminorm interpolant. 
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5. 7. 1 Convergence to the data function 

In Section 15.31 the Exact smoother problem of Definition 11681 was studied using the Hilbert space V = 
X^(8)C^ endowed with the inner product ^(/, a) ,(^g,lij^ = p (/, g)^ e^'h ^ ^"^^ operator 
Cx ■ — ^ V defined by Cxf = (yf,£xf^ for a set of N independent data points X. 

In Theorem 1 1701 it was proven that ||>Cx/|lv' s-'^ equivalent norm to ||/||^, g which implies that X^^ is 
also a reproducing kernel Hilbert space under the norm The space V induces on X^ the inner 

product 

if'9)v,wM ^ i^x.f,Cx9)v, fi 9 ^ X^^. 

Under this inner product X^ is a reproducing kernel Hilbert space with a unique reproducing kernel 
function, and consequently there is a unique Riesz representer of the functional / — > / (x) which we 
denote by ^v,x i-c 

f{x) = {f,mv,,)y^^,, feXlxeR". (5.26) 

The equations 

(/, R^)^.,e = / (2^) = (/, '^v,.)v,^,e = i^xf, £x':^v,.)y = (/, , (5.27) 



imply that C*xCx^v,x — Rx and by Theorem ll75l the operator LX^Lx '■ X^ —> X^ is a homeomorphism 
so we have 

mv,x ^ {C*xCxr' Rx- (5.28) 
The equations 15.271 also imply there exists a unique Rv,x € V such that 

f {x) = {Cx},Rv,x)y , Rv,x — ^x^v,x, Rx = C*xRv,x- (5.29) 

As mentioned above we are interested in estimating the pointwise error of the Exact smoother Se with 
respect to its data function fd, where the independent data is X and the dependent data in y = £x.fd- 
By |5J9| the error is {x) ~ fd (x) = {Cx (se - fd) , Rv,x)v and 

|Se (x) - fd {x)\ = \ {Cx {Se " fd),Rv,x)v\ < W^X {Se - fd)\\v \\RvM\v ' 

From part 3 of Theorem 11711 

WCxSe - 4l + \\Cx i-Se - ml = WJ^xf -41, / e Xl 

where C = (0, y) = (o,£xfd^ ■ Thus when f = fd 

\\Cx (se - fd)\\v < W^xfd - {0,£xfd) 1^ = IfdL^e Vp- 

and 

|Se {x)-fd{x)\<\fd\^,^\\Rv.Av 

Finally, using [???7l we have 

= {Rv.x, Rv,x)y — {Cxy^V,x, Cx^V,x)y = ^V,x (x) ■ 

The above analysis is summarized as: 

Theorem 186 Suppose is the Exact smoother generated by the independent data X and the data 
function fd G X^. Then 

\seix)-fdix)\<\fd\^g^\\Rv,x\\v^ ^-eK^, (5.30) 
where p > is the smoothing coefficient, Ry.x £ V is given bv \5.28\ and \5.2^ and satisfies 

\\Rv,x\\l^'^v,x{x). (5.31) 
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It is clear from Definition 1 1671 of the Exact smoothing problem that the Exact smoother is independent 
of the order of the points in the unisolvent independent data X. This allows the convenient definition 
of a special minimal unisolvent set Xi C X: we assume that Xi = {x^''^]^_ , is a minimal unisolvent 

subset and let X2 — {^^'^ }^jv/+i' "^^^ ihew used to construct the Riesz representer R^, the 

semi-Riesz representer — QRx, the Lagrangian operators V, Q, the basis function spaces Wc,x and 

Wg,x, and the Light norm (•, •)^ g. This section will also use the 'prime-double-prime' notation to denote 
components related to Xi and X2 e.g. a — {a' , a") with a' € C*^ and a" G C^^*^. 

The next step is to calculate ||i?y,a;||y using [LH^ From C*^Cx^v.x — Rx and from part 4 

Theorem [nOl C*xCx = pQ+ jfS^Sx so that 

pQ^v,x + ^S'x^x'y^v^x = Rx- (5.32) 

We will solve equation 15.321 for Dlv.x by solving the equivalent system 

Qvx+£x0^x = Rx, (5.33) 

-^^XVx = aa:, (5.34) 

for ax £ and G X^, so that 

P^v,x = Vx, Rv,x = Cx^^v^x = (^^Vx,Nax^ ■ (5.35) 

We first apply the operator V to 15.331 by part 7 of Theorem 11391 VEx^x — ct^Lxl and applying V 
to 14. 361 gives VRx — l{x) I so 

V (Qvx -f £*xax) = 0^x1x1= Tixfl 
which implies the equivalent equations 

Lxax = T{x) , a'x = T{x) - Lx^a'^. (5.36) 
Next apply the operator Q to 15.331 since QRx — rx 

N N 

Q (vx + £x<^x^ = Q'"x + 2 X! ^ ^'"^ + X! (^^)k '^xW = 'Tx-, 

k=l k=M+l 

and thus 

N 

Qvx^Tx- ^ {ax)f.r^^k). (5.37) 

We now left-compose 8x2 with 15.371 From part 8 Theorem 11391 Ex-i'Pf — LxSxif so that applying 
£x2 to the left of 15.371 and then using [17501 gives 

£x2 Qvx = £x2 (vx ~ Vvx) = £x2Vx - Lx2£xiVx = Np {a'x - ^XjaL) ■ 
Next left-compose £x2 with 15.371 and use the notation described in Definition 11791 to obtain 



TV \ 
=M+l J 



£x2Qvx^£x2 y'x- {ax)k'>'xW I ^■rx2,x~rx2,X2ax- 

The last two sequences of equations yield 

{Npl + rx2,X2)ctx = NpLx2a'x + rx2,x, 
so that substituting for a'^ in the last equation using 15.361 and then rearranging gives 

{Np (/ + Lx.ixJ + rx2.X2) ol'x = NpLx2l{x) + rx,,^. (5.38) 
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We know from Theorem 11801 that rx2,X2 is positive definite and sinee the cardinal unisolvency matrix 
is real- valued it follows that Np (j + ^^2^^ ) + '"^2,^2 is also positive definite and hence regular. 
Thus [5~551 and [5.361 define uniquely and which means [5.331 defines w up to a polynomial of^rder 9. 
However 15.341 actually supplies the information which defines Vx uniquely. Indeed, from I5.34( £xi Vx — 
Npa'x so that 



Vvx iy) = Np {a'f I (y) = Np [l (x) - L^^al) ^l{y)^ Np (l {xf 



i{v) 



Npl{xY l{y)-Np{alY LxJiy) 



and as a consequence of 15.371 
Vx (y) = Vvx (y) + Qvx (y) 



Npl {xf I (y) - Np {a'^f LxJ (y) + Qv. (y) 
NpT{xfT{y) - Np {a'^f Lx^Tiy) + (y) - 



N 

E 

k=M+l 



io'x)krxW iy) 



= Tx iv) + Npl [xf I (y) - Np {alf Lx^l {v) - WL) rj^y 
= Vx [y) + Npl{xfT{y) - (a^')"^ f iVpi^ /(y) + 



= Vx (y) + Npl {xf I (y) - {a'^^f {Np {l + Lx^L^J + r^^) a'^ 
= rx {y) + Npl{xfT{y)- 

- (NpLx2l{x) + rx2,x) {Np (/ + ix^^xj +^=3?^)"' (iVpix/(y) + 



(5.39) 



(5.40) 



where the last two equations were derived using [?7551 Since N p {l + L x^L'^^) + ^-^2,^2 is positive 
definite, its complex conjugate inverse is positive definite and when y = x equations 15.311 [5.391 and 15.351 
imply 



P\\Rv.x\\v = P'^V.x {x) 

The next theorem summarizes these results: 



Vx {x) < Tx {x) + Np I {x) 



Theorem 187 Suppose Se is the Exact smoother generated by the independent data X and the data 
function fd G X^. Then 



p\\RvM\v {x) + Np l{x) 



(5.41) 



and 



\se {x) - h {x)\ < IfciLe \h-x {x) + Np I {x) 



X e 



To study the convergence of the Exact smoother we will also need Lemma 11481 which supplies some 
elementary results from the theory of Lagrange interpolation and was used in Chapter 4 to derive orders 
of convergence for the interpolant. These results are stated without proof. This lemma has been created 
from Lemma 3.2, Lemma 3.5 and the first two paragraphs of the proof of Theorem 3.6 of Light and Wayne 
[lOj . The results of this lemma do not involve any reference to weight or basis functions or functions in 
X^, but consider the properties of the set which contains the independent data points and the order of 
the unisolvency used for the interpolation. Thus we have separated the part of the proof that involves 
weight functions from the part that uses the detailed theory of Lagrange interpolation operators. 

Lemma 188 (Copy of Lemma \14S^ Suppose that: 

1. Q. is a hounded, open, connected subset ofW^ having the cone property. 

2. X is a unisolvent subset of CI of order 6. 

3. {Ij^'^^^i is the cardinal basis of Pg with respect to a minimal unisolvent set of VI. 

Then by using Lagrange interpolation techniques it can be shown there exists a constant g > 



such that 



l{x) 



M 



(5.42) 
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and all minimal unisolvent subsets of^l. Now define 



hx — sup dist (lu, X) . 



and fix X G X. Again using Lagrange interpolation techniques it can be shown there are constants 
CQ e, hn,e > such that when hx < /in,e there exists a minimal unisolvent set A C X satisfying 



diauiA^ < cnehx, 



(5.43) 



where A^ — AU {x}. 



We will now prove our first Exact smoother error estimate Theorem 11891 which implies an order of 
convergence rj. In Theorem 11501 conditions on the basis function G were supplied in order that the semi- 
Riesz representer rx {y) = QyRx (y) satisfy a condition of the form 15 .4il required below by Theorem ll89l 



Then in Theorem 1 1 521 an estimate for the interpolant error was derived which is just the Exact smoother 
error estimate 15.451 with p = 0. 

Theorem 189 Let w be a weight function with properties W2 and W3 for order 9 and parameter k and 
set rj = min {0, ^ [2kJ}. Suppose the notation and assumptions of Lemma \188\ hold. Assume there exist 
constants ccTg > 0, independent of A and x £ such that 



\/rx (x) < [1 + l{x) ) ^/c^(diamA^)'' , diamA^ < re, x e 



where Ax ~ A\J {a;}. 

Then there exist constants cq^q, hfi^g, Kq g > such that 



{x) - fd {x)\ < IfdL^g (1 + K^e) {V^ {cnAxT + V^^p) , 



X eQ, 



(5.44) 



(5.45) 



when hx < min ?'g}- Here Nx = \X\ and the constants cn^e, h^^g, Kq g only depend on il,9,K 

and d. 



Proof. From EID of Theorem [TH7| 



Vp\\Rv,x\\v ^ Vrx{x)+ l{x) ^N^, xeM.'^. 



(5.46) 



Fix X E ^ and let A be any minimal unisolvent subset of X. Define rx using A so that by 15.441 and 
Lemma [1881 we have 



V^x (x) < (l + / (x) J (diam A^)" < (1 + Kl^ g) ^ (diam A^) 



(5.47) 



when diam < tq. But hx < /if2.e so that by Lemma ll88l there exists A such that diamA^; < cn^ghx 
and 15.471 implies 

Vrx {x) < (1 + K'f^^g) {cufihxf . 



l{x) 



to the inequalitv 15.461 for Rv.x we get 



Applying this estimate and the inequality 15.421 for 

^fp\\RvA\v ^ + [-^{cnfihxf ^ V^P) : x^n, 

and the smoother error estimate 15.301 now becomes 

\Se{x)- fd{x)\ < \fdL^g^/p\\RvM\v 

< \fdUg{^ + Kke){V^icn.ehxy' + ^/N^), x e n. 

Since Se and fd are continuous on M'^ the last inequality actually holds for x G O and 15.45] is true. ■ 
The next result shows that in a certain sense the Exact smoother converges to its data function. 

Corollary 190 The Exact smoother converges to its data function fd in the sense that given e > there 
exists a positive integer K {fd',£), a nested sequence of independent data sets X'^'^^ C X^''^^^ C fl and a 

(k) 

sequence of smoothing parameters Pf. > such that the corresponding sequence of Exact smoothers Se 
satisfies 



(x) - fd (x) 



< £, X e fi. 



(5.48) 



when k > K {fd; e) 
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Proof. From Theorem 11511 there exists a nested sequence of independent data sets X^*^^ such that 

as /c "> oo. To derive the bound [5".48l we start with incquaUtv 15.451 so 

that 



X eft, 



when hxik) < min {/i^.e, tg}. Now observe that for some positive integer Kq (fd), hxw < hn^g when 
k > Kq (fd)- Next, choosing pf. such that (cnfihxw)^'^ = \/Nx(''>Pk imphes 



(x) - fd (x) < 2 \fd\^ g (1 + X^^e) V^(cn,e/ix(-))''^ ,x£n, 



and as hxik) 0, Sg —^ fd uniformly on Q. The statement of this coroUary now foUows directly. 



5.8 Improved error estimates 

In this section we start by deriving an estimate which has a slightly improved order of convergence: 
for the example of the shifted thin-plate spline this is 1/2. Then a double rate of convergence will be 
demonstrated for data functions that are linear combinations of Riesz representers. As a function of the 
smoothing parameter p these convergence estimates are unbounded and we end this chapter by deriving 
some error estimates bounded in p. 



5.8.1 A slightly increased order of convergence 

Our slightly improved Exact smoother error estimate will be Theorem 11911 In Theorem 11561 conditions 
on the basis function G were supplied in order that the semi-Riesz representer (y) = QyRx (y) satisfy 
a condition of the form 15.4"^ (below) which allows for an improved order of convergence oi t] + 5g- Then 
in Corollary 11571 an estimate for the interpolant error was derived which is just the improved Exact 
smoother error estimate 15.501 (below) with p = Q. 

Theorem 191 Let w he a weight function with properties W2 and W3 for order 9 and parameter k and 
set rj = min|^?, i [2kJ}. Suppose the notation and assumptions o f Lemma 1 1 88\ hold. Assume there exist 
constants cgiTq > and Sg > 0, independent of A and x such that 



Vrx (x) < (l + / (x) J y/c^ (diamA^r)''^*'' , diamA^ < re, xe n, 



(5.49) 



where A^ ^ AU {x}. 

Then there exist constants CQ^g, hci^g, g> ^ such that 



\se (x) - fd {x)\ < IfdL^g (1 + K^g) icn.ehxT^''' + Vn^p) , x e 



(5.50) 



when hx < min{hfi^g,rG}. Here Nx — |^| and the constants c^^g, hfi^g, g only depend on VL,6,k 
and d. 



Proof. The will follow closely that of Theorem [TH3 From[5lI]of Theorem [W] 



^\\RvA\v ^ ^/^■Ax)+ l{x) ^/n^, xeM.'^. 



(5.51) 



Fix X E ^ and let A be any minimal unisolvent subset of X. Define rx using A so that bv 15.491 and 
Lemma [1881 we have 

VM^< |^(^)|J (diamA,)''+''' < {1 + K'^^g) ^ {dis.mAxT+''' , (5.52) 

when diam^j: < tg- But hx < h^i.e so that by Lemma ll88l there exists A such that diamyla; < cn.ghx 

< (1 + K'^m) [cnAxf^'" ■ (5.53) 



and 15.521 implies 

Applying this estimate and the inequality 15.421 for 



lix) 



to the inequality 15 . 5 1 1 for Ry.x we get 



VpWRv.xWv ^ i^ + K.e) (V^icn.ehx) 



xp 



X E fl, 



(5.54) 
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and the smoother error estimate 15.301 now becomes 

\Se {x) - fd ix)\ < \fdL^gVp\\Rv,x\\v 



< 



Since Se and fd are continuous on the last inequahty actuaUy holds for x E Vl. ■ 

In the examples below, to maximize the rate of convergence, we define rj = max min {^?, ^ [2kJ }. 

Example 192 Thin plate spline basis functions By Theorem^TJ^the thin-plate spline weight func- 
tions are given by 

w{0 = ^,\^\'^'^''^', eeK', (5.55) 
e(s) 

and have properties W2.1 and W3.2 with positive integer order 6 and non-negative k iff k < s < 9. 
Now rj = max min {0, ^ [2kJ } = 5 [2kJ and from the conclusion of Example 1 of Section \4.11\ Chapter 

equation \5.49\ is satisfied for = 1 and Sq = -r, (2s — [2sJ ) when s > 0, s ^ 1, 2, 3, . . . and for rQ = 1 
and any < (5g < ^ when s = 1,2,3,.... 

Example 193 Shifted thin plate spline basis functions By Theorem^T^the shifted thin-plate spline 
weight functions are given by 

w iO = |^|-2.+2«+d ^ ^ _^/2, 

e{s)Ks+d/2{a\^\) 

and have properties W2.1 and W3.2 for 6 and all k>0 iff —d/2 < s < 6. 

Now rj = max min {6*, 5 [2kJ ^ — d arid from the conclusion of Example 2 of Section \4-ll\ Chapter^ 
\5.49\ is satisfied for arbitrary ro > and 5g = ^■ 

Remark 194 



1. 



Relating hx to Nx and the convergence of the smoother 



Theorem \191\ derives the smoother error estimate 15.501 

|se {x) - fd {x)\ < |/,L,, (1 + K'^^b) (V^icn,ehxr^''' + ./W^p) , 

when hx < min {/in, e, '"g}/ with the awkward term Nx which is linked to hx in an indirect manner. 
In order to have a meaningful concept of the convergence of a smoother a relationship between hx 
and Nx needs to be introduced. This situation did not arise with interpolant. 

2. In general the data X is scattered and for a given value of hx the number of points Nx can be 
arbitrarily large. However, for data on a regular, rectangular grid we have the relation 

d'^/^ vol [grid) = Nx {hxf ■ (5.56) 

3. In Williams \22^ several 1- dimensional numerical experiments were run to compare the conver- 
gence of the zero order Exact smoother with the predicted convergence. One- dimensional data sets 
were constructed using a uniform distribution on the interval fl ~ [—1.5, 1.5]. Each of 20 data files 
were exponentially sampled using a multiplier of approximately 1.2 and a maximum of 5000 points, 
and then logi^hx was plotted against logi^N where N = \X\. It then seemed quite reasonable to 
use a least-squares linear fit and in this case we obtained the relation 

hx 3.09N-°-^\ (5.57) 

For ease of calculation let 

hx^hiiNxy", /ii = 3.09, a = 0.81. (5.58) 
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4- A barrier to the use of such a formula as \ 5.57\ in higher dimensions is the difficulty of actually 
calculating hx for a given data set. If a sequence of independent test data sets was generated by a 
uniform distribution in each dimension then the constants a and hi might be defined as the upper 
bound of the confidence interval of a statistical distribution. Also, noting regular arid formula \5.5S\ 
we might hypothesize a relationship of the form 



hx=h^ [Nx)-""': 



for higher dimensions 

5. 



The order of convergence Assuming 1 5. 58\ we will now show that for a sequence of independent 



data points Xk of increasing density there exists a sequence Pf. of smoothing coefficients such that 
the smoother error is of order rjQ ^ rj + Sq in hx^. • 

By Theorem ] 1 9 1\ 

\f, (x) - S3, J, {x)\ < (1 + K'^^o) {cnAx^r^' + y/N^) , x eH, 

when hx^ < min {hfi g , re} . For clarity define the constants 

A^\fdL,e{^ + Kke)V^{cn,er'' , ^ = l/dL., (l + ^ (5-59) 

so that 

Then condition \5.58\ implies 

\fdix)-S3,Jd{x)\<A{hx,r^+B^(^^^ xen, (5.60) 

and we want to minimize the right side as a function of hx^. ■ This is easily done by setting the 
derivative to zero so that 



= 0, 

and a unique minimum is obtained when 

VPk 



""''^ihx.r^^^. (5.61) 



B 



[hi 



By substituting for y^p^ in the right side of \5.60\ we find that the corresponding minimum error 
value is given by 

\f,{x)-SS,Jd{x)\ < A{hx,r-+B^(^ 



hi 

= Aihx.r- +2ar,aA{hx,r'' 
= il + 2ar^a)Aihx,r'' 

= (1 + 2arja) |/dL,, (l + K,e) {cn^xS" ■ 

Thus if hxk and Pf. is chosen to satisfy \5.61\ then the Exact smoother error always converges 
uniformly to zero and the order of convergence is at least {hx^Y'^^'^ ■ Note also that the minimum 
error is independent of hi. 
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6. From \575T\ the convergence of p^, to zero is of order 2r]Q + ^ in hx- One might consider saying that 
the smaller this order is the better in order to avoid stability problems when p is small? 



7. 



Error behavior in terms of p The p error curve is well known, always becoming constant with 



large p and decreasing as p decreases and then it may increase again to the interpolant error value. 
Its observed slope behavior depends on the basis function: with decreasing p: 

• Thin-plate spline slope increases like \5.50\ then levels out. 

• Shifted thin-plate spline slope keeps increasing like \ 1.261 

• Gaussian slope oscillates with increasing positive amplitude. 

• B-splines - when n = I = I the slope tends to zero. For other splines it doe not. 

Note that observing the behavior of the smoother for small p may run into stability problems and 
the limitations of accuracy. 

If we assume our X data lies in ]S} and that hx and Nx satisfy 1 5. 58\ then we obtain the error 
estimate 1 5. 6 (A 

i_ 

\f,{x)-S^xJd{x)\<A{hxJ'^^B^p{^^ xeTi. 

Clearly the slope always tends to infinity for small p and always tends to infinity for large p, which 
leaves much to be desired. However, in Subsection \5.8.!^ we will establish error estimates that, for 
given X, are constant for large p. 



5.8.2 Doubled order of convergence 

In this subsection a double rate of convergence in terms of hx will be demonstrated for data functions 
that are linear combinations of Riesz representers. We will again use the assumptions and notation of 
Lemma 11881 regarding the open set which contains the independent data points. The convergence results 
will be applied to the case of semi-regular sequences of independent data points. 

The operator Cx of Definition 11681 is not onto but by Theorem 11701 it is 1-1, and since Cx {Xf^) is 
not dense in V the usual definition of the adjoint does not apply to . However, by Theorem 11751 
C,\C.x ■ — !■ X^ is 1-1 and onto and this property is used in the next lemma to extend to V as 
a continuous operator and allows a definition of {^x^) ■ 

Lemma 195 The operator {Cl^^) : The operator {C*xCx) ^ C,*x ■ ^ ^ -^fv ^ continuous extension 
of H'^ to V. Define the operator (C^^) by {^x^) = (j,C*xCx) ^ ^*x^ ■ Then (C^^) has the following 
properties: 

1. {C-^y =Cx{C*xCx)-\ 

2. {C*xCx)-' = C-^' {C-^y . 

4. {c^Y -i^*x^xr'c*^. 

Proof. The operator {C*xCx)~^ CJ'x ■ V is a continuous extension of to V because 

{C*xCxr'C*xCx^I. 

Part 1 Since C*xCx : X^ ^ X^ is 1-1 and onto, (^{C*xCxy^y = {{CxCx)*)~^ = {CxCx)~'^ and 

so, {C-^y = ({C*xCx)-^ C*xy = Cx {C*xCx)-\ 

Part 2 Left-compose with the equation of part 1. 
Part 3 Left-compose C*x with the equation of part 1. 

Part 4 By definition {C^y* = ([CxCxT^ C*xY - {C*xCxr^ C*x. ■ 

The next result gives more properties of the function v^ studied in the previous subsection, as well 
as defining and studying the object ry.x' = ('^x^) ^a;' ^ ^ which is used to derive the double order 
convergence estimates. 
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Theorem 196 Suppose Sj^ is the Exact smoother mapping and fd E is a data function. Then: 

1. L*xRv,x — Rx and Rv,x = {^x) Rx- 

2. U{x) - S'xfdix) = P [{Cx'Y Qfd, Rv^x) ^ = ifd.vx). 



lw,B- 



3. Rx' {x) —S'jrRx' {x) ~ p {rv,x' T Rv,x)y = Qx'Vx' (x), where rv,x' = {^x^) ^2^' '^'^'^ subscript on 
the operator Qx' indicates the action variable. 

4- p\\rv,x\\v - (^)- 

Proof. Part 1 From ESI and [OS Rx = C\Rv,x, ^iv^x = {C^CxT^ Rx and Rv,x = Cx^v,x- Thus by 
part 1 Lemma [TOSl Rv.x — Cx {C\Cx)^^ Rx — {^^)* Rx- 

Part 2 Fromimi S^^fd ^ fd- P {C*xCxT^ Qfd- Hence 

fd (x) - S'xfd {x) = [Cx {I - 5^) fd, Rv,x)y = P [Cx {C*xCxr^ Qfd, Rv,. 

= p (^{C^'Y Qfd,C*xRv,x) , 

= P (^fd,{C*xCx) ^ C*xRv,x''^ 

But the equations 15.291 imply '^v.x — {^*x^x) ^ C,*xRv.x and bv l5.35[ pd\v,x = Vx so it follows that 

fd {x) - Sjcfd (x) = p {fd, ^V,x)^ g = {fd, Vx)^^g ■ 

Part 3 Substitute fd = Rx' in part 2 so that 



Rx' {x) ~ SxRx' {x) = p {rv,x',Rv,x)v = Q^x {x') = Qx'Vx' (x). 

Part 4 From part 3, rv,x — {^x^Y ^x so that from part 1 Lemma [1951 

= {rv,x,rv.x)v = ((-^x^)* "^x, {^x^Y ^'i^ y ^ {^^ {^*x^xy^ rx,Cx {C^CxY^ rYj^ 

= {{CxCxT^ rx,rx 



Now let Zx — {C*xCx) ^ Tx so that Theorem 11161 and part 7 Theorem 11251 imply 



But by part 4 Theorem fTTUl 



\\rv,x\\y ^ Qzx (x) . (5.62) 



C*xCxZx = pQzx + -^Sx^xZx = rx, 
which is equivalent to the system 

Qwx+SxPx = fx, (5.63) 

-^^£xwx = Px, (5.64) 

where 

pzx = Wx. (5.65) 

We now want to calculate ||ry^:r|j^^ by solving the svstem [5.631 15.641 15.651 and then using [5T62I To do 
this we use the analogue of the method used to calculate — ^v,x (x) subsequent to Theorem 

11861 This involved solving the svstem [5. 33[ 15.341 15.351 for ^iv.x- Using this technique yields 



Wx (y) = Tx {y) - r^,^^ {Np {I + Lx^L^xY) + "^x-^.x^) ^ rx^ 
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SO that 



p\\rv,x\\v pQzx (x) ^ Qw^ (x) ^ Wx (x) 

= (x) - r^^ {Np {I + Lx^LxJ + rx^.Xa) ^rJc^x 
< (x) , 



T ^ -^rx2.X2) ^ is positive definite. 
We can now derive our double order convergence estimates. 



since it was shown after 15.381 that (^Np (/ + 



Theorem 197 Suppose 5^ is the Exact smoother mapping of Definition \146\ Sg = ^xfd '^'^^ ^-c 
the Riesz representer of the functional f ^ f (x) defined using a minimal unisolvent subset A. Set 
Vg — V + ^g- Then: 

1. If x,x' e r2 and hx < min {/i^.e, ?'g} we have the double order of convergence estimate 

{x) - SScRx' {x)\ < (1 + K',,^gf ^ (cnM'''' {V^ {cnAxT'' + V^Pj ■ 



N' 

2. If X' — C ri, hx < mm{hfi^g, re} and the data function has the form fd — ^ Pk^x' for 

some Pk G C then 

\fd{x)-s,{x)\< (El^fclj {^ + K'^fif ^{cnfihxf'' (y^icnAxf^ + Vn'^ , 2; e H. 



N' 



3. If A a X' then the data function of part 2 lies in Wg,x' ■ 

Proof. Part 1 If x, x' £ M'^ then by first using the Cauchy-Schwartz inequaUty and then the estimates 
15.411 and part 4 Theorem II 961 for ||-Ry,2:||y and ||ry ,j;/||y we obtain 



\Rx. (x) - S'xRx' (x) 



< 



p\irv,x',Rv,x)Y\ < p\\rv,x'\\y ||^y,a;||. 



ix') 



\ 



r^ (x) + Np I (x) 



P 



< V^x' {x')\ {x) + Np I {x) 



< y ) (^/r.x{x) + y/N~p\l{x)\^ 



< \AvM y/rx (x) + y/Np I {x) 



(5.66) 



Regarding the last inequality, if x,x' £ Q, and hx < h^^g then we can uniformly estimate ^/rx' {x') 
and W (xWsing 1^7551 and uniformly estimate l{x') using [5321 Hence 



\Rx'{x)^S'xRx'{x)\ < Vr [VrAx) + K'^^g^p) 

< {1 + K'^^g) ^ {cn,ehxr'' [{l + K^^g) {cn^hxT'' + K[ 



(1+K'g) 



(cn^ehx)"'' {cn.ehxT'' + Vn~p) 
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N' 

Part 2 The proof proceeds by applying the uniform estimate of part 1 to each term oi fd = J2 Pk-^x' ■ 

fe=i 

Thus 



\U{x)-S'kh{x)\ < 



N' 

(x) - (x)) 



fc=i 

N' 



, k=l 



N' 



l<k<N' 



, fc=i 



Part 3 li A C X' then by part 6 Theorem I166[ R^' G Wg.x' for each fc, and so fd G Wg.x' 



Remark 198 Following the approach of Remark \194\ we will now show that if we assume hx and N 
are related by 1 5. 58\ then for a sequence of independent data sets in ]S} there exists a sequence p^, of 
smoothing coefficients such that the smoother error is of order 2r]Q in hx,. ■ 
By part 1 Theorem \197\ when hx^ < min {/isi,e, tg} 



\fdix)-S3cJd{x)\<{l + K^e) V^{cn,ehxT'' [V^icn^ehxT^ + VNp) , x e n. 
For clarity define the constants 

^= + V^Ke)''^ B = l + K'^^s, (5.67) 

so that 

I /, (x) - /, (x) I < A' (/.X J'"^ + AB^ {hx,r^ 2; e fl. 

The condition \5.58\ implies 

\fd{x)~S^xJd{x)\<A^hx,f'^+AB^{h,)^{hxJ'''-^, xeTl, (5.68) 

and we want to minimize the right side as a function of hx^ ■ This is easily done by setting the derivative 
to zero so that 



D 



^,^[A^hx,f''-+AB^{h,)^ihxJ'--^) = 2^aA^hxj''--' + 



VG-^]AB^{hx, 



= 0, 



and a unique minimum is obtained if rjQ < In this case hx^ satisfies 



which can be written 



2^-VgB 



(5.69) 



(5.70) 



By substituting for p in the right side of \5.68\ we find that the corresponding minimum error value is 
given by 



{hx,f'^+AB^{h,)^{hxJ 



vg- 



A' {hx. 



AB ^ 



A'ihxj'"^+A'^^{hx,f'^ 



2vc 



^^A^hx^f'^ 
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so that ^ 

Thus if TjQ < ^ and hx^ — > and pf. is chosen to satisfy \5. 70\ then the Exact smoother error will 
converge uniformly to zero and the order of convergence will be at least {hx^)^^'^ ■ 

On the other hand if r]Q > ^ then notina [5.68\ choose p^. so that ^/Pki^XkY''^ ^" ~ {^x^f'^'^ so 
that 



and hence \5. 68\ becomes 

and again the Exact smoother error converges uniformly to zero and the order of convergence is at 
least {hxi^)^^^ ■ 

5. 8. 3 Error estimates hounded in the smoothing parameter 

As a function of the smoothing parameter p the convergence estimates of the previous two subsections 
tend to infinity as p — > cx). However, numerical experiments indicate that the error is a bounded function 
of p and we will now derive some convergence estimates with this property. The first step is to derive an 
estimate for the Exact smoother error which involves the Exact smoother functional Jg. First recall the 
notation of Lemma [1881 

Theorem 199 Let w be a weight function with properties W2 and W3 for order 9 and parameter k and 
set 77 = maxminj^, i [2kJ}. Assume G is a basis function of order 9 such that there exist constants 

cg > and Sq > such that \5.4!^ holds. Set rjQ — rj + Sg- 

Suppose Se is the Exact smoother of the data function fd on the unisolvent independent data X with 
Nx points. Suppose A <Z X is a minimal 9 -unisolvent set and that {lk}\^^i is the corresponding unique 
cardinal basis for Pe . Set Ax = A U {x} . 

Then if x € Q and diam A^ < re then 



\fd{x)-seix)\ < \ fdL^s {I + K'n^o) ^ {diam AxT^ + K'n^sVN^JA^l (5-71) 
and further if hx < {^o,e,?'G} then 



\fdix)~s,ix)\ < l/dL,, (1 + K'^,e) V^icn^ehxT'' + K'^^eV^xJe [se]- (5.72) 
Here Je is the Exact smoother functional. 
Proof. Fix X £ V, and suppose A — {0^}^^.^. Then 



M 



fd (x) - Se (x) = {fd - Se, Rx)y,^g = {fd - Se,rx)^ g + ^ {fd {uk) " Se (flfc)) k {x) 



k=l 

SO that 

M 



\fd{x) - Se{x)\ < {fd- Se,rx)^g^+^\fd{ak) - Se{ak)\\lk{x)\ 

k=l 

< \fd - Sel^^g \rxL^g + ( max|/d(afc) - Se {ak)\j ^ l^fe (a;)| 

= \fd - Sel^ g \/rx {x) + f max|/d(afe) - s^ (afc)| j ^ \lk {x)\ . 

Since x G fl the estimates l5.42l and l5.52l impl v 

\fd {x) - Se {x)\ < \ fd ~ Sq|„ g (l + K^g) ^ (diamA^)''^ + ^max|/d {ak) - Se {ak)\ 



144 



5. The Exact smoother and its convergence to the data function 



From|5J91 fd (x) - Se (x) = [Cx (fd - Se) , Rv.x)y so that 

\fd{ak) - Se (afc)l < \\Cx {fd - Se)\\y \\Rv,aJ\y , 



but Remark [l69l with f — and part 3 of Theorem llTll with f — fd yields \\Cx {fd ~ Se)\\Y < Je [se] 
so that 



\fd {x) - Se {x)\ < \ fd - SeL e (l + V^G (dianiyl^)''<=^ + K'n,0\/ Je [se]ma.x\\Rv,aJv ■ 

k 

FromEm \\Rv.aJ\y < ^ and byElwith / = fd, \ fd - SeL,^ < l/<iL,9 so that 

\fd {x) - Se {x)\ < l/dL g (1 + K',,^g) V^(diamA,)"« + K[, g^NxJe [se], (5.73) 



which proves [5.711 Finally, since hx < {h^,e,rQ\, Lemma [1881 implies diamAj^ < CQ^ghx and so 15.731 
implies 15.721 ■ 

Next we estimate the term Je [se] which occurs in both inequalities of the last theorem. 

Theorem 200 Let w be a weight function with properties W2 and W3 for order 9 and parameter k and 
set rj = maxminj^, i [2kJ } . Assume G is a basis function of order 9 such that there exist constants 

cg > and Sq > such that \5.4^ holds. Set tjq = rj + Sq. 

Suppose Se is the Exact smoother of the data function fd on the independent data X . 
Then if D, is a hounded, open, connected subset ofW^ having the cone property: 



VXR< |/dL,emin{VP: {^ + K'n.e) V^(diamr!)'''=} , 

where p > is the smoothing parameter. 

Proof. Choose a unisolvent set A C X to define the operators V and Q. 

From the definition of the smoother problem Je [se] < Je [fd] — p\fd\1j g ■ Also 



(5.74) 



Je[Se] < Je[Pfd]= p\rfd\ 



1 ^ I 



d X 



k=l 



7 1 ^ 



fe=l 

< max I Qfd {x) 



Fix X G and using the properties of Q given in Theorem 11161 and the properties of the scmi-Riesz 
representer given in Theorem 11251 we have 



\Qfd{x)\^ (fd,r^)^^g < l/dL^e \rx\^M = \fdL.e V^x {x). 



But from 1131] 



Vrx {x) < [1+ l{x) J V^(diam^,)''« < [l + K[^^g) ^ {drnm^f^ , 



so that 



V Je [se] < max|Q/d(x)| < |/dL,einax VMa?) < l/dL.e (l + ^Lo) V^G (diamf])'''^ 



We now combine the last two results to obtain our improved error estimates which are bounded in p. 

Theorem 201 Let w be a weight function with properties W2 and W3 for order 9 and parameter k and 
set rj — min {9, ^ [2kJ } . Assume G is a basis function of order 9 such that there exist constants cq > 
and (5g > such that \5.4^ holds. Set rjQ = rj + 6g- 

Suppose Se is the Exact smoother of the data function fd on the unisolvent independent data X with 
Nx points. Suppose the notation and assumptions of Lemma \188\ hold so that the data point density is 
hx = sup dist {to; X). 

Then there exist constants Cfn^g, hn^g, g> ^ such that 

\fd {x) - Se {x)\ < l/dL,, (1 + K',,^g) (diam A,)"- + 

+ l/dL e ^ min (l + K',,^s) V^(diamf])'"=} , (5.75) 
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and 

\Jd{x)-s,{x)\ < \fdL^e{^ + KLe)V^{cn,ehxr'' + 

+ \fdL,e V^min { V^, (l + K^^g) ^ (diam f])''^ } , 

for X G fl. 

Here the constants cn,e, hci^e, K^^ g only depend on fl, 9, k and d. 

Proof. The inequalities of this theorem are obtained by applying the estimates for y'Je[se\ proved in 
Theorem 12001 to the estimates of Theorem 11991 ■ 

Remark 202 For a given independent data set X the bound [7. 751 is a bounded function of p. However, 
numerical experiments indicate that there should be a bound that is also independent of Nx ■ 
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The Approximate smoother and its convergence to the 
Exact smoother and the data function 



6.1 Introduction 

The Approximate smoother problem is derived from the Exact smoother problem by restricting the range 
of the minimizing functions from X^, to a space Wg,x', where X' is an arbitrary set of unisolvent points 
in R'^. 

The Approximate smoother problem is solved twice, first using Hilbert space methods and then using 
matrix methods. A matrix equation is derived and the construction and solution of this equation is shown 
to be scalable w.r.t. the number of data points i.e. it depends linearly on the number of data points. 

Estimates are first derived for the pointwise convergence of the Approximate smoother to the Exact 
smoother and these are then added to the Exact smoother error estimates to obtain the error of the 
Approximate smoother. These estimates involve uniform pointwise convergence and derive orders of 
convergence. However they are basically unsatisfactory and are very rough estimates when compared 
with numerical results. I have not included the results of any numerical experiments in this chapter. 

Section by section: 

Section l6.2l A study of the convolution spaces Jq = Sij^g® Pe and Jg = G*Sfiig. The hat indicates 
the Fourier transform. 

Section 16.31 Formulation of the Approximate smoothing problem - The Approximate smoother prob- 
lem is derived from the Exact smoother problem studied in Chapter [5] by restricting the range of the 
minimizing functions from X^ to a space Wg,x', where X' is an arbitrary set of 0-unisolvent points 
in K''. The first step is to assume that X' is a regular grid containing the Exact smoother data and 
to approximate or discretize the functions in Xf^ using this grid. This leads to the finite dimensional 
subspace Wq x' and the Approximate smoother problem, namely min Jg [/] , where Jg is the Exact 

smoothing functional. We then generalize this problem to an arbitrary unisolvent X' . 

Section 16.41 Studying the Approximate smoothing problem using Hilbert space techniques. We now 
know the Approximate smoother exists, is unique and is a member of Wg,x' ■ The next step is to derive a 
matrix equation for the coefficients of the X'-translated basis functions and the basis polynomials. This 
proof is quite similar to that of Theorem II 831 which derives the Exact smoother matrix equation. 

Hilbert space techniques are used to show that the Approximate smoothing problem has a unique 
solution. We obtain a matrix equation for the Approximate smoother. 

N' 

Section 16. SI Matrix techniques are used to derive the matrix equation. We write f = J2 '^iG (• — + 

J2 PjPj S W^G X' and calculate J [/] as a quadratic form in terms of (a^ f3 1 restrained by Px'Ct = 0. 

We next show the quadratic component is is positive definite and then obtain the matrix equation for 
the Exact smoother using Lagrange multipliers. 
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Section 16.61 For a bounded data region f2 we first derive some uniform, pointwise convergence results 
which do not involve orders of convergence e.g. in CoroUarv 12291 it is shown that as the points in X' get 
closer to those in X the Approximate smoother converges uniformly to the Exact smoother on Q,. We 
next derive some orders of pointwise convergence for the Approximate smoother to the Exact smoother 
and then add these to the Exact smoother estimates of Chapter [5] to obtain the Approximate smoother 
error. 



6.2 The convolution spaces Jq and Jq 



In this section we define the convolution spaces Jg which will be used to discretize the space in the 
derivation of the Approximate smoothing problem in Section 16.31 The notation Jq comes from Section 
3 of Nira Dyn's review paper ^ and similar results are proved here. 

Theorem 203 Suppose the weight function w has property W2, and suppose G is a basis distribution 
of order 9 > 1 generated by w. Then ip £ S$ g implies G * ip G X^ and if £ Sii, g 



{G * ip,G * 



I i2e 



[G, (p_ * 



where ip _ (x) = {—x). Also, if f £ X^^ then 



(6.1) 



(6.2) 



Proof. CoroUarv II 141 implies that £ Sij^ g implies G * ip £ X^ for ^? > 1 and that 16.21 is true for 9 > 1. 
It remains to prove [^7T] 

From CoroUarv 11141 \G * ip\1^ g — J J^^jao when ip £ Si^^g. Since X^ is a semi-inner product vector 
space with complex scalars the semi-inner product can be recovered from the seminorm by 



(G * ^, G * = 1 (|G * ((/) + nig - |G * (0 - nl^g) + 
+ '-(\G*{^p-i^)\lg-\G^{^ + i^)\ 



2 



/(0,V') 



,29 



where 



(p + 'ij.> 



-f 

4 V 



tp — icj) 



Ip + i(j) 



and so the first equation of 16. II holds. 

Now if pijijj £ Sfii^g then by part 2 of Theorem [151 <?V' G S$^2e- Thus by Definition [44l of a basis 
distribution of order 9 we have 



{G*ip,G*lp)^g = 



I |20 



G,pip 



= [G, ip_*iJ] 



where we have used the Fourier transform and convolution identities listed in the Appendix. ■ 

Definition 204 The spaces Joand Jq- Suppose the weight function w has property W2. Suppose G 

is a basis distribution of order 9 > generated by a weight function w. Then the spaces Jco-nd Jg are 
defined by: 

Jc^G^Si^^e, JG = JG®Pe- 

Here Si^ g denotes the Fourier transform of the functions in S'g g and G * Si^ g denotes the convolution 
of the tempered distribution G with the functions in Si^^g. 

The use of the direct product in the definition of Jg must be justified and we must show that the 
definition is independent of the particular basis function chosen. 
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Theorem 205 Suppose the weight function w has property W2. Suppose G is a basis distribution of 
order 9 > 1 generated by a weight function w. Then: 

1. JGnP = {0}. 

2. P20 * ^0,e C Pe- 

3. JG,^JG,^ffGi-G2eP9- 

4-. Set-wise, Jq is independent of the basis function G of order 9 used to define it. 
5. Jg is dense in X^, when endowed with the Light norm. 

Proof. Part 1 Suppose Jg H P {0}. Then we can choose p E P, p ^ and ip E S^i^g such that 
p = G * ip. But p e impUes p E Pg so from equation l6.1l 



0=\p\l, = \G.p'' I 1"^'' 



I i2e ■ 
w • 



which imphcs ip = 0, and so ip — and p = 0. 

Part 2 Suppose q E P2S. Then by part 1 of Definition [H] q = Gi — G2 for some basis distributions 
Gi and G2. Thus by Theorem I203|, q * 50_e — Gi * Sii,^g — G2 * Si^^g C X^. But q * S'g^e is a space of 
polynomials so q * S^^g C Pg. 

Part 3 Suppose Jgi — Jg2 - Then given E S:^ g there exists E g such that Gi * (j) — G2 * 'ip. 
Thus G2 * ^7/; — (/)^ = (Gi — G2) * </) = q * G P, for some q E Pje- 

Part 1 of this theorem now implies that ^ = 4> and q * </> = 0. Indeed, we can conclude that q* (p — Q 
for all (p E Sfi g, or equivalently, cpq — for all (p G 'S'g.e- But part 2 of Theorem [T71 implies that q E Pg 
and so Gi — G2 £ Pe- 

Conversely, if Gi - G2 G Pe and (p E S$^g then (p (Gi - G2)^ = for all (p E 3$^, or (Gi - G2) * = 

for all (/) e 5*0 5). Hence J^^ = Jg2- 

Part 4 By Definitions^ Gi — G2 G P26i- Set q = Gi — G2. Now suppose u S Jgi , so that u = Gi *(p+p 
for some (p E Sijj g and p E Pg. Consequently 

u — Gi*<p + p^G2*(p + (Gi — G2) *(p + p = G2*(p + q*(p + p, 

and by part 2 the last two terms are members of ■ Repeating the argument for u E Jgi proves this 
part. 

Part 5 A standard result is that a subspace of a Hilbert space is dense iff its orthogonal complement 
is {0}. 

Suppose {f,G * (p + p)^ g = for all E Sqi^g and p E Pg. Now when p = —V (G * (p) 
= (/, G * + p)^^g = (f,G*.p+p)^^g + J2f (ak) {G*cP + p) (flfe) 

k 

where the last step used 16.21 Hence [/, ^ =0 for all cp E Sqi g and by Theorem [T71 f E Pg. Now we 
have {f,p)^ g = for all p E Pg, which imphes g — ^ and so / = 0. ■ 



6.3 Formulation of the Approximate smoothing problem 

The Approximate smoother problem is derived from the Exact smoother problem studied in Chapter O 
by restricting the range of the minimizing functions from X^ to a space Wg,x', where X' is an arbitrary 
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set of S-unisolvent points in M.'^. The first step is to assume that X' is a regular grid containing the 
Exact smoother data and to approximate or discretize the functions in using this grid. This leads to 
the finite dimensional subspace Wa,x' and the Approximate smoother problem, namely min Je [/], 



where Je is the Exact smoothing functional. We then generalize this problem to an arbitrary unisolvent 
X'. 

In this section we will provide some justification for approximating the infinite dimensional Hilbert 
space Xf^ by a finite dimensional subspace Wg,x', where X' is a regular, rectangular grid of points in 
M.'^. The space Wg,x' will be used to define the Approximate smoothing problem. The set X' will then 
be generalized to include any finite set of distinct points. 

Definition 206 A regular, rectangular grid in 

Let the grid occupy a rectangle R{a;b), which has left-most point a e K*^ and right-most point b. 
Suppose the grid has M' = {N[, N!^, . . . , A^^) points in each dimension and let h g denote the grid 
sizes. 

Then X' — {x^ = a + ha | a G Z'* and < a < A/"'} is the set of grid points. 

Let N be the number of grid points so that N = iAf')^ = ^[^2 ■ ■ ■■^d' '^^^ '^f course we have the 
constraint M h = b — a. 

The definition of the space Wg,x' requires that X' is unisolvent. If X' is a regular, rectangular grid 
the next theorem shows that if the grid is made finer in all dimensions the grid eventually becomes 
unisolvent, no matter what order of unisolvency is required. We will need the following lemma: 

Lemma 207 We have the following unisolvency results: 

1. The set {7 G Z"* : < 7 < is unisolvent w.r.t. P„. 

2. Translations of minimal unisolvent sets are minimal unisolvent sets. 

3. Dilations of minimal unisolvent sets are minimal unisolvent sets. 

Proof. Part 1. From the definition of unisolvency. Definition [Ml we must show that for each p ^ Pn, 
p (7) = for < 7 < ^ implies p = 0. The proof will be by induction on the order of the polynomial. 
Clearly the lemma is true for n — 1 since Pi is the constant polynomials. 

Now assume that n > 2 and that if p G P„ and p (7) = for < 7 < n then p — 0. Set p (x) = 
^ cpx^ . Then if 7^ = and 7,; — 1 when i ^ k then = ^ C/37^ implies cp — when Pf. ~ 0. 

|/3|<n |/3|<n 

Thus p (7) = for < 7 < implies Cfj ~ when /3j = for some i. Consequently, p = if n < d else 
P (^) = X] CfjX^ . If n > d we can write p {x) — x^q {x) where q G Pn-i, so that q (7) — for 1 < 7 < n 



must imply q = 0. Finally, if we define r G Pn-i by r (x) = q{x -\- 1) then r (7) = for < 7 < n — 1 
must imply r = 0, and so the truth of our lemma for n — 1 implies the truth of the lemma for n, and the 
lemma is proved. 

Parts 2 and 3. From the definition of a cardinal basis, Definition llOOi there is a unique cardinal basis 
{li} of Pn associated with a set A = {a^} iff A is minimally unisolvent of order n. Now by definition 
li (oj) — 5ij. Hence, if r,(5 G M'' and S has positive components, then the cardinal basis associated with 
the translation A + r is {li (• — r)} and the cardinal basis associated with the dilation 6 A is {li {-/S)}. ■ 

Theorem 208 Suppose X' = {x^ — a + ha \ a £ 'E'^ and < a < A/"'} is the regular, rectangular grid 
introduced in Definition \206\ Then X' is 6-unisolvent if M' > 0. 

Proof. Since {X' — a) /h ~ {a \ a E Z"^ and < a < A/"'} and TV' > 9, part 1 of the lemma implies 
{X' — a) /h is 0-unisolvent and thus from the definition of unisolvency. Definition 1991 [X' — a) jh must 
contain a minimal unisolvent subset. Parts 2 and 3 of the lemma imply that X' contains a minimal 
unisolvent subset and so X' is unisolvent. ■ 

By Theorem 12051 the space Jq — G * S$£ + Pq is dense in X^ under the Light norm sense. So we 
will approximate functions in 50. g using the grid X' defined above. Our analysis will be matrix-based so 

order the grid points and write X = {x^j^^j^. We will approximate integrals on the grid region using 
the trapezoidal rule i.e. 



l/3|<n 
/3>0 




(6.3) 
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where = x . . . x hd- 

Stepl Approximation of the functions in Jq = G * Si^^g by functions in W g.x' ■ 

We now need a basis for Pg, say {qi}fLi where M = dim Pg. Then 5*0. ^ has the following characterization 
which we will not prove here: 

5*0.9 = £ S : J qi{x) (j) {x) dx = 0, for all l^ . (6-4) 
Suppose (j) G S(i) g. Then the trapezoidal approximation [^31 on the grid X' we have 

N' 

G*0= / G(x-y)0(y)d2/^^G(x-O(/iV«)), (6-5) 

and 

N 

qi [x) (j) (x) dx^^qi (a;^) (/i^ (a;^J) ■ (6.6) 



Considering the equations and approximations l6.41l6.5l and l6.6l we will approximate the space G * 50_e 

N' n' 

by functions of the form G {x — a;^) a„, a„ G C constrained by ^ (x^) a„ = for / = M . In 

n=l n=l 

matrix terms these constraints become PxiCt = 0, where a — (q;„) and Px' = {qj {x'^)) is the unisolvent 
matrix introduced in Definition 11031 But noting Definition 11631 we see that our approximating space is 

just Wg.x', provided X' is unisolvent. But by Lemma [2081 this is true if N' > dimPg. 
Step 2 Approximate Jq — G * 8$^ + Pg by Wg,x' = Wg,x' + Pe- 

Step 3 With this motivation we could now specify a smoothing problem, which we will call an 
Approximate smoothing problem, which involves minimizing the Exact smoothing functional Jg given 
bv l5.6l over Wg,x' where X' is a rectangular grid. However, since the space Wg,x' is defined when X' is 
any 0-unisolvent set of distinct points we will define the following more general problem: 

Definition 209 The Approximate smoothing problem 

Minimize the Exact smoothing Junctional [/] for f G Wg.x' , where X' is a 9 -unisolvent set of 
distinct points in M'*. More concisely we can write min Jg [/]. 

The Exact smoothing functional Jg [/] is given by \5.6\ and is defined using the scattered data [X, y] 
where X — {a;*-*-* }^_-|^ is the 9-unisolvent independent data and y — termed the dependent data. 



6.4 Solving the Approximate smoothing problem using Hilbert space 
techniques 

In this section Hilbert space techniques are used to show the Approximate smoothing problem has a 
unique solution in the finite dimensional space Wg,x'- We then prove several identities satisfied by the 
smoothing function and obtain a matrix equation for the coefficients of the basis functions of the space 
Wg,x'. 



6.4-1 Summary of Exact smoother properties 

To start with we will require the following properties of the mapping Cx and the Exact smoother which 
were proved in Section [5.31 

Summary 210 Suppose [X, y] is the data for the Exact smoothing problem and X is a 9-unisolvent 
set. Assume the operators V , Q and the Light norm ||-||^^ g are all constructed using the same minimal 
unisolvent subset of X . Then: 
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1. //C = (0,y) then \\Cxf - <r||y - Je[f] for f e (RemarkmW- 
From Theorem \ 1 70[ ' 

2. Cx ■ Xf^ V is continuous and 1-1. 

3. If u = {U1U2) & V then C*xU = pQui + ■^£^M2 w.r.t. the Light norm constructed from a minimal 
unisolvent subset of X . 

4. L\Lxf — pQf + jj^x^xf when f £ X^. Also, C'xCx '■ X^ — > Xf, is a homeomorphism and 
C*xCx ■ Wg,x Wg,x is a homeomorphism. 

From Theorem \ni\ 

5. WCxSe + WCxSe - CxfWl = ll-Cx/ - ^lly for all feXi. 

6. The Exact smoother problem has a unique solution s^ in Wq x o,rid this preserves polynomials in 
Pe- 

7. The Exact smoother of the data [X, y\ is given by s^ — jf {C*xCx) ^ ^xV- 

6.4-2 The existence and uniqueness of the Approximate smoother 

The geometric Hilbert space technique of orthogonal projection is used to show the Approximate smooth- 
ing problem has a unique solution in Wg,x' ■ 

Theorem 211 The Approximate smoothing problem of Definition \20d{ has a unique solution in 
Wg,x', say Sa, which satisfies: 

1. Je [sa] < Je [/] for all f G Wg,x' and f ^ s^. 

2. [CxSa - CxSa - Cxf)v = for all f G Wg,x', where <j = (0, y) G V. 

3. \\Cx Sa '^^lly ^" ll-C^Sa ^xfWy — \\^x f for all f G Wg,X'- This is equivalent to part 2. 
C*xCxSa — ji^xV' f) ^0 f'^''' / ^ Wg,x'- This is equivalent to part 2. 

5. The Approximate smoother is independent of the basis function G chosen to construct Wg,x' ■ 

6. If Sc is the Exact smoother of the data y then Sa — Se = {^*x^x) ^ 9 for some unique g G Wq x'- 

N „ 

7. p\Se - Sa\\ e + ^ E - Sa = Je {Sa\ ~ Je [Se] • 

fc=l 

Proof. Part 1 From part 1 of Summarv l210l J,. [ f] = H-Cx/ — <^||y- So now we want to show that there is a 
unique function / G Wg,x' which minimizes the functional \\Cxf ~ over Wg,x'- By part 3 Theorem 
I166[ Wg,x' is a finite dimensional subspace of X^ so Cx {Wg,x') must be a finite dimensional subspace 
of V and hence a closed subspace of V. Consequently there exists a unique element of Cx {Wg,x'), say 
v, which is the orthogonal projection of C onto Cx {Wg.x') such that \\v — < \\Cxf — ^Hy for all 
/ G Wg,x' and Cx (/) ^ v. 

Since Cx is 1-1 on X^ there exists a unique element of Wg,x', call it Sa, such that v = Cx (sa)- 

In terms of Je we have Je [sa] < Je [/] for all / G Wg,x' and f ^ Sa. 

Parts 2 and 3 Since v is the projection of C onto Cx {Wg,x') we have the equivalent equations of 
parts 2 and 3. 



Part 4 We study the equation of part 2 using the properties of the operators Cxf = yf, ^xf] ^ V 
and C*x given in Theorem 12101 In fact, for all g G Wg,x' 

= {CxSa ~ CxSa ~ Cxg)v = {J^XSa - <^ , Cx (Sa - = {C*xCxSa - C*x<., Sa - g) ^ f. 

C*xCxSa - j^£*xy^ Sa - g 
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But Sa & Wq X' so 



C*xCxSa - -j;^£*xVif 



and this is clearly equivalent to part 2. 



Part 5 From part 1 of Definition [163] we know that the set Wq.x' is independent of the basis function 
used in its construction, and since the Exact smoother functional [HSl is independent of the basis function 
the result follows. 

Part 6 Part 4 imphes directly that C*xCxSa — jj^xV ^ ^gx'^ ^^Y ^*x^xSa — jj^xV — 9i ^'^'^ this 
part follows since by part 7 of Summary 12101 Sg = {C*xCx) ^ ^xV- 
Part 7 Substitute f ^ Sa in the identity [57 



Je [Se] +p\Se- f\l^g + T7 



fc=l 



„(fe) 



Remark 212 In part 4 above we proved that C^^xSa — j^^xV ^ ^gx'- ^'^■^ necessary to assume 
that X was 6-unisolvent and that X' was 9-unisolvent. However, the minimal unisolvent subsets of X 
and X' used to construct E^, V , Wg,x' etc. are not required to have any points in common. We must 
be careful to avoid any calculations which are dependent on both X and X' but which may only be valid 
when it is assumed that X and X' share a minimal unisolvent subset and this set is used to calculate V , 
Q, the Light norm etc. For example, consider the equation Sx'Sx'^ ~ ^X'.xct- What minimal unisolvent 
subset is used to calculate Rx ? In this example a minimal unisolvent subset of X is used to construct Rx 
which is then evaluated using X' and X . 

6.4-3 Various identities 



The identities of this subsection are similar to the Exact smoother identities of Corollary 11721 and Corol- 
lary 11731 They relate the Hilbert space properties and the pointwise properties of the data and the 
Approximate smoother. 

Corollary 213 Suppose Sa is the Approximate smoother of the data X = jx^*)} and y = {yt} induced 
by the points X' , and fd G X^ is a data function for the Exact smoother. Then for all / G Wcx' : 



P\Sa 



1 ^ 



■'-it,+^Y.\'A'"')-i 

i=l 

1 ^ 



2. Iffd^Wa^x' then 



N 



\fd\ 



Proof. Part 1 Expand the equation of part 3 of Theorem 1 2 1 1 1 using the formula — P 



w,e 



N 



jf^\u (a;*-*-*)! implied by the definition of Cx and V fPefinition llGSp . 

i=l 

Part 2 Set f — f^ in part 1. ■ 

The result of part 4 of Theorem 12111 is used to proye the next corollary. 

Corollary 214 Suppose Sa G Wg,X' is the (unique) Approximate smoother of the data [X,y] induced 
by the points X' . Then: 
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2. Px {y — {sa)x) ~ ^ where Px is any unisolvency matrix defined using X . 

4. Je{Sa) = jj{y- {Sa)xfy- 

Proof. Part 1 By part 4 Summary I210[ C*xCxSa = pQsa + jf£*xSxSa and by part 1 Theorem 11161 
(Qsa,/)^,e = (■Sa,/)^,e so that if / e Wg,x': 

= (CxCxSa - l^Sxy. f) = (pQ-'^a + ^rxSxSa ~ ^S^y . f 



pQSa + JjSx {^XSa -y^ 
^ P{SaJ)^^g + ^{£xSa~y,£xf)^^ (6.7) 



= P {Sa, Dyj^g + -^{s-y, fx)c» 

1 J, 

= P{SaJ)yj^g + Jj{{Sa)x-y) fx, 

and hence ^ 

(Sa, f}^^g ^ Wp''^" (Sa)xf fx- 

Part 2 Suppose {pi} is a basis for Pg. Then ii f — Pi € Pg the equation proved in part 1 becomes 

(y ~ isa)x) and so (Px)^ ((sa)x - 2/) since Px = {pj {x'^'^))- 
Part 3 Let / = Sq in the equation proved in part 1. 
Part 4 By part 3, \sa\l^g = (y ~ isa)xf 

Je{Sa) = P\Sa\l^g + -^\{Sa)x-y\^ 

= P\''a\l^g + jj{{Sa)x^y'^){is^)x-y) 

= P\Sa\l^g + (iSa)x " {s a)x V ' y'^ is^)x + y'^V) 

= ^ (y - {Sa)xf (S^)x + ^ ((Sa)x " V ' y^ {s^)x + V^v) 

= ^ {y^ is^)x - («a)x is^)x + iSa)x is^)x " (^a) J V ' is^)x + V^v) 

^ (- {safxv + v'^y) 



N 

1 J,_ 
-j^iy- {sa)x) y- 



2 T T T 2 

Part 5 Part 3 implies |(sa)xl ^ {sa)xy = y ^'^'^ ^^^^ 4 implies (sa)x ^ < ll/l ■ ■ 

(J./^./^ Matrices and vectors derived from the Riesz representer and the basis function 

The interpolation and Exact smoother problems only involve a single independent data set X and 
this leads to matrix equations which only use matrices of the form Rx.x — {Rx^i) (■^'■*'')) Gx..x = 
)) . However, the Approximate smoother problem fDefinition l209p involves two independent 
data sets X and X' which will require the following definitions: 
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Definition 215 Matrices and vectors derived from the Riesz representer and the basis 
function G 

Suppose Y — {y'-'"'^} and Z — {z'^'"'^} are arbitrary sets of points in M"* and y,z £ R'^. Then: 

1. Ry,z = {R,u> (y(^')) and Gy.z - (G (y(^) - z^^"))). 

2. Ry,, = {R, and Gy, = (G (y(^) - z)) . 

3. Ry,z = (2/)) and Gy^z = (G (y - z^^'))) . 

-Ry.z is called a (asymmetric) reproducing kernel matrix and Gy^z is called a (asymmetric) 
basis function matrix. 

The next result derives an important relationship between the reproducing kernel matrix and the basis 
function matrix. 

Theorem 216 Suppose now that A is a minimal unisolvent set with cardinal basis by Define 
the Riesz representer Rx using A and {li}^i- Then ifY = {y^*^-*} and Z = {z^'^-'} are arbitrary sets of 
points in M."^ : 

1. 

Ry^Z — (27r) 2 (^Gy^z - LyGA.Z - Gy,AL^ + iyG^.A^i) + LyL^. (6.8) 
2. IfY and Z are sets of distinct points in then £y£'^ — Ry^z- 
Proof. Part 1 From l4?35l 

M M 

(27r) ^ R,{y) = G{y-z)-Y, I, iv) G (a, - z) -J^G iv - a^) k (z) + 

j=i i=i 

M M 

or in the notation introduced in Definition 12151 

R, (y) = (2^)-^ {G{y-z)~l{yfGA..~GyJ{z)+l{yfGAj{z)) +T{yfT{z), 

Now Ry,x is the row vector {R^u) (y)) and Lx = (ij (a^^*^)) so 

Ry,z = (27r)-^ (^Gy,z -T{yf Ga,z ~ Gy^AL'^ +T{yf Ga^aL^) +T{yf L'^, 

and hence ^ 

Ry,z = (27r) 2 (Gi',z — LyGA.X — Gy,AL^ + LyGx,xL%) + LyL^ 

Part 2 Suppose Y = {y^'^}, Z = (z^^)} and /? = (/S^). Then from Definition [HS] and IMOl 

N N 

£yE*zP = ^/3/yi?,u, = ^/3, (y(''))) = Ry,zP, 

where the last step used the definition of Ry^z from Definition 12151 ■ 
6.4-5 The Approximate smoother matrix equation 

We now know the Approximate smoother exists, is unique and is a member of Wq.x'- The next step 
is to derive a matrix equation for the coefficients of the data-translated basis functions and the basis 
polynomials. This proof makes good use of the identities of Subsection 16.4.31 and the properties of 
unisolvency matrices, and is quite similar to the proof of Theorem 1 1831 which derives the Exact smoother 
matrix equation. This proof will require notation to deal with inner products, Riesz representers etc. 
which are generated by two minimal unisolvent sets A and A' : 
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Notation 217 Suppose A and A' are two minimal unisolvent sets and A is the "default" notation. Let 
(•, •)^ g be the Light inner product generated by A' , R'^ be the Riesz representer generated by A' and £\i.x 

be the adjoint of Ex w.r.t. (-j-)^ 9- 

Regarding unisolvency matrix notation, if the Pq basis used for Px' is different to that used for Px 
then use the notation P'xi instead of Px' ■ In contrast, no 'prime ' notation is required for the cardinal 
unisolvency matrix Lx' because the (cardinal) basis used to calculate Lx' is uniquely determined by A' . 

Theorem 218 The Approximate smoother matrix equation 

Fix a basis function G of order 6. Choose a minimal unisolvent set A' C X' and a Pq basis {pi} to define 
the unisolvency matrix Px' , the Riesz representer R'^ and the space Wg,X' ■ Choose a minimal unisolvent 
set A <Z X and the Pg basis {pi} to define the unisolvency matrix Px , the Riesz representer Rx and Wg,x ■ 

Now suppose s G Wg,X' is the (unique) Approximate smoother of the data X = {x^*^}^ ,y — {yi) 
induced by the set of points X' — {x'^}^^-^. Since s £ Wg,x' 

N' M 

s(x)=^a:G(.T-a;D+^/3:K(x), (6.9) 

i=l i=l 

for some a ~ (aj) G and (3' — (/3^) £ C^^. In fact, a' and satisfy the Approximate smoother 
matrix equation 




{2^Y NpGx',x'+Gx',xGx,x' Gx'.xPx Px' 

PlGx.x' P^Px Cm \ \ P' \ = \ Px I y. (6.10) 

Pi Om 



where Gx'.x' = G (a;J — x^), Gx'.x = G (x^ — a;^^-*), Gx',x — G (a;'*-' — x^) are basis function matrices 
and Px = {pj i^'"^"')) <^iT'd Px' = (Pj (Xi)) o.tg unisolvency matrices ( Definition 1 1 03\) . 

The matrix on the left of this equation will be called the Approximate smoother matrix and will 
usually be denoted by the symbol . 



Proof. From part 3 of Definition 11631 the space Wg,x' is independent of the ordering of the points in 
X' . Thus the Approximate smoothing problem is also independent of the ordering of the points in X' 
and we now take advantage of this to order X' so that the first M points of X' lie in A' . Equation 16.71 
of the proof of Corollary 12 141 is 

{Sj)ra,e = ^{y-^XS,£xf) , feWG,X', 

SO the Light norm corresponding to A' is 

= ■^{y-£xs,£xf^ + (£A'S,£A'f) 

where we have used Notation 12171 By part 6 Theorem 11661 the Riesz representer R'^ e Wg,x' when 
X £ X' so the last equation implies 

£x' {^s - £X>,a'£a'S + -^^A'-x (s - £xy^^ = 0, 

or ^ ________ 

Np£x'S - Np£x'£*A,.A'^A'S + £x'£*A'-x^xs - £x'£a'-xV = 0- 

By part 5 Theorem ll39l and Definition 12151 £x'£a'-a' ~ -^X' ^'^^ ^X'£a' x = ^-x'-x 

Np£x'S - NpLx'£A'S + R'x'-x^xs - R'x'-xV = 0> 
and for clarity we revert to the subscript notation for evaluations: 

Npsx' - NpLx'SA' + R'x'-.xsx - R'x'-.xV = Oi 
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or 

Np {In' - Lx':o) sx' + R'x'.x (sx - = (6.11) 



where the augmented square matrix Lx'-.o = {Lx' On,n-m) was introduced in part 3 Theorem[TI 
Setting Y = X' and Z = X in formula 16.81 and using the special ordering of X' mentioned at the start 
of the proof we obtain 

(27r)^ R'x,^x - Gx'^x - Lx'Ga'^x - Gx'A'Lx + Lx'Ga',A'LI + (2^)* Lx'L^. (6.12) 
Part 2 of Corollary 12141 implies {sx — y) = 0- Using this equation and l6.12 | 16.111 becomes 

= {2tt)^ Np{lN'~Lx':o)sx' + {2n)^ R'x, ,,{sx~y) 

= (27r)^ Np {In' - Lx':o) sx' + {Gx'^x - Lx'Ga',x - Gx',a'LJ. + Lx'Ga',A'L^x) [sx - y) + 

+ {2n)i Lx'L^x {sx - v) 
= {2n)i Np {In' - Lx':q) sx' + {Gx'.x - Lx'Ga'^x) {sx - y) 

d 

= (27r) 2 Np (/at/ - ix':o) SX' + {Gx'.x - Lx':aGx',x) sx - (Gx'.x - Lx':qGx',x) y 
= (27r)^ Np {In' - Lx':o) sx' + (In' ~ Lx'-.o) Gx'^xsx - {In' - Lx'-.o) Gx',xy- (6.13) 
The next step is to express the factors sx' and sx in basis function terms. But from the statement of 

AT' M 

this theorem, s {x) = a'^^G {x — x'^) + ^ /^jPj i^) constrained by 
i=i j=i 

P^,a' = 0, (6.14) 

so that 

sx = Gx,x'a + PxP', SX' - Gx',x'a + Px'P'- (6.15) 

From part 3 of Theorem 11041 we know that Px' — Lx'Pa', where Pa' is regular. Also from part 3 
Theorem 11051 L x'-nL y/ = Lx'- Hence 

{2TTyNp{lN' - Lx':o)sx' + {In' - Lx':o)Gx'^xsx 

= (27r)^ Np {In' - Lx':o) {Gx',x'a' + Px'P') + [In' ~ Lx'-.o) Gx'.xsx 
= {2n)i Np {In' - Lx':o) {Gx',x'a' + Lx'Pa'0) + {In' - Lx'-.o) Gx',xsx 
= {2TT)i Np {In' - Lx':q) Gx',x'a' + {In' - Lx'-.o) Gx',xsx 
= (27r)^ Np {In' - Lx':o) Gx',x'a' + (In' - Lx'-.o) Gx'^x {Gx.x'a' + PxP') 
= (In' - Lx':o) (((2^)^ NpGx'^x' + Gx',xGx^x') a' + Gx'^xPxP'] 
= ((2^)* NpGx'^x' + Gx'^xGx,x) ol + Gx'.xPx0~ 
— Lx'-.Q ((27r)^ NpGx'.X'a' + Gx'^xGx,x'a' + Gx',xPxP') , 
and 16.131 becomes 

= {{2n)^ NpGx',x'+Gx'.xGx^x)a' + Gx'^xPxP' ~ 

—Lx'-.Q ((2^)^ NpGx',x'Oi' + Gx',xGx,x'a' + Gx',xPxP' 
— (In' — Lx':o) Gx'.xy 
(27r)^ NpGx',x' + Gx'.xGx^x') a' + Gx',xPxP' - Gx'^xy - 

((2^)« NpGx'.x'a' + Gx',xGx,x'Oi' + Gx',xPx0 + Gx'.xy 
{2ix)i NpGx'.x' + Gx'.xGx^x) a' + Gx',xPxP' - Gx'^xy - 

-Lx' ((2^)^ NpGA',x'a' + GA',xGx,x'a' + Ga',xPxP' + GA',xy) , 
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From part 3 of Theorem 11041 we know that Lx' = Px'Pa^ i where Pa' is regular, so 

= ((27r)^ NpGx',x' + Gx',xGx^x) a' + Gx-^xPxP' - Gx'^xy- 

- Px'Pa' ((27r)^ NpGA'.x'a' + GA',xGx.X'a' + Ga',xPxP' + Ga',xI 
which we write as 

((2^)^ NpGx'.x- + Gx-,xGx^x') d + Gx'^xPx0 + Px'i = Gx',xV, (6.16) 

where 

y = P^} NpGA'^x'a' + Ga'^xGx^x'u' + Ga'^xPxP' + Ga',xv) ■ 

Finally, from part 2 of Corollarv l214l it follows that {sx — y) = and thus substituting for sx from 
16.151 we obtain 

PxGx,x'a' + PlPxP' = Ply. (6.17) 

Equations 16 . 14[ | 6 . 161 and 16 . 171 now combine to give the Approximate smoother (block) matrix equation 
QUI 

At the start of this proof we assumed a special order for the points in the ordered set X' . To prove 
that the Approximate smoother is unchanged by reordering the points X' we use the permutation matrix 
approach. In fact we will show that for the permutation tt of X' 



( i2ny NpG^^x')MX')+ G^^x'),xPx P.(xo \ 

+ '^-k{X').x'^X,tt(X') 

M 



PlGxMX') P^Px O, 

\ P^,x') Om Om J 



7r(a') 




( Gtj(X'),X 




y 


Pi 


i 




\ Om,n 



(6.18) 



and 

M 

s {x) = G,,,(x')'r (a') + ^iP^ ■ ("^-IS) 

Denote the permutation matrix of tt by 11. To reorder the rows of a matrix we left-multiply by 11 and to 
reorder the columns we right-multiply by H^. Also n^II = lUI-^ = /. Hence, G'^(x'),7r(X') = ^Gx' ,x'^ , 
Gx,-k(X') — Gx,X'^^ , Gt^{^x'),x = ^Gx'.x and Pt^(x') = nPx'. The left side of the equation of the first 
row of 16. 181 now becomes 

(^(27r) 2 N pGt,(x'),tt{X') + G^(X'):xGx,7r(X')) ("') + Gt,(x'),xPxP' + Pit{X')j' 

^(27r)^ TVpnGjf^x'H^ + TiGx'^xGx,X'Tl^) Ha' + nGx'^xPxP' + HP^'Y 

= n (((27r)^ NpGx'^x' + Gx'.xGx^x') H^Ha' + Gx',xPxf3' + Px'i) 

= n (((27r)^ NpGx'.x' + Gx'.xGx.x) a' + Gx'.xPxP' + Px'i 
= IiGx',xy 

— Gt^(^x').Xi 

where the last line is implied bv l6.10l Thus the equation of the first row of 16. 181 is true, and the other 
equations are proved in a similar manner. 

Using the notation of Definition 12151 we can write 16.91 as 

M M M 

s {x) = Gx^x'a' + (x) = Ga;,x'n^na' + {x) = Gx,-k(x')'^ [a') (x) , 

i=l j=l j=l 

which proves [5. 191 and finishes the proof. ■ 

Remark 219 A different basis for Pg, say {p'j} , could he used to define the unisolvency matrix Px' , the 
Riesz representer R'^ and the space Wg,X'- Using the conventions of Notation \217\ we would write P^, 
instead of Px' ■ All the results proved below would still hold. 
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Recall from Definition 23] that the set of basis functions of order 6* is G + P2e , where G is a particular 
basis function. However, from part 5 of Theorem 1 2 1 1 1 we know that the Approximate smoother function 
is independent of the basis function chosen. The next corollary tells us that we can always choose a basis 
function such that the Approximate smoother matrix is Hermitian and indeed this particular matrix 



allows a simple proof of regularity which is given in Theorem 12211 

Corollary 220 Suppose the weight function w has properties W2 and W3 for parameter 9. 

Then a (possibly complex-valued) basis function G of order 9 can always be chosen so that Gy z — Gz.y 
for all finite subsets Y and Z of R'* i.e. so that G {—x) ~ G {x) for x G . For such a basis function 
the Approximate smoother matrix 5* of 1 6. 1 0\ is Hermitian and we can write 



i2TT)- NpGx',x'+Glx,Gx,x' G^^^.Px Px- 
* = I PlGx.x' ^ PlPx Om I . (6-20) 

P'^. Om Om 



where Af = dim Pa 



Proof. From part 2 Theorem [521 there exists a basis function G which satisfies G {—x) = G [x] for 
X e M.'^. The condition Gyz = Gz,y implies that G^^, x' — Gx',x' and G\ x' — Gx'.x and since Px 
and Px' are real valued it follows that has the required Hermitian form 16.201 ■ 
In the next theorem we will prove the Approximate smoother matrix [6. 201 is regular. 

Theorem 221 The Approximate smoother matrix 5* specified in Corollary \220\ has the following prop- 
erties: 

1. ^> is a regular Hermitian matrix. 

2. ^' is square with N' + 2M rows. Hence the size of 5* is independent of the number N of (scattered) 
data points. 

Proof. Part 1 We first write ^ in the form. 

{2ny NpGx';o + GlGp 
Px' On',m 

where 



* = 




Gx' fl — ( ^ ) , Gp — ( Gx,x' P: 



Gx'.x' O 
O Om 

Since Gx.x is Hermitian ^' is Hermitian. To prove that 5* is regular we use Lemma 11431 To this end 
set 



B = {2tt)^ NpGx';o + GlGp, 

Px' 
Om.n' 



G = 



It must be shown that nuUG = {0} and that z^Bz = and G^ z = implies z = Q. 

Firstly, GA = implies Px'A = which implies A = since nuUPx' = {0}. Therefore nuUG = {0}. 

Next, set z'^ — (^v'^,p'^^. Hence, since 

C^z={Pl 0)(^)=PI,., 

we conclude that G^ z = implies Px'V = 0. Now assume that G'^z = 0. Then 

((27r)* NpGx'-o + GlGp^ z = (27r)^ Npv'^Gx'.x'v'^ + z'^G^Gpz 

= {2tt)^ Npv^Gx',x'V + \Gpz\l« . 



z'^Bz = z^ 



By part 4 of Theorem ll661 Gx',x' is conditionally positive definite on nuUPj, i.e. Px'V = and v 
implies v^Gx' X'V > 0. Therefore, z^ Bz = implies v = Q. 
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In addition, we have Gpz — i.e. = Gx.x'V + PxP — PxP, so that f3 — since nuUPx — {0} by 
part 1 Theorem 11041 We conclude that z = 0. 

Part 2 We observe that Gx'.x' has size TV' x N', Gx,x' has size N x N', 

Px has size N x M, and Px' has size A^' x M. From the block sizes it is clear that is square with 
N' + 2M rows. Hence the size of ^ is independent of the number of (scattered) data points N. ■ 

Our next result shows the Approximate smoother algorithm is scalable i.e. the time of execution of 
construction and solution is linearly dependent on the number of data points. This is in contrast with 
the Exact smoother which is not scalable but which has quadratic dependency on the number of data 
points. 

Corollary 222 The Approximate smoother algorithm is scalable. 
Proof. The Hermitian matrix equation 16.201 is 

i27:)i NpGx'.x'+G^Gx,x' Gl ^,Px Px' \ ( ^ \ ( W]^' \ 
P^Gx'.x P^Px Om ][ (3 ] = [ 

Pi Om Om / \ ^ / \ Om,n J 

where Gx',x' is N' x N\ Gx.X' is x iV', Px' is N' x M and is iV x M. 

Suppose the evaluation cost for G [x) is mc multiplications and that N ^ N' , N :s> M and N :s> m^. 
The construction costs for component matrices and matrix multiplications are: 



Construction costs for Approximate smoother matrix 


Gx',x' 


Gx,x' 


Gl.x'Gx.x' 


PxGx',x 




[p^ \y 

\ Om,n ) 


[N'f ma 


N'NrriG 


[N'Y N 


N'NM 


[N' + 2Mf 


N {N' + 2M) 



From the table the dominant construction costs are N' N (N' + mc + M). The solution cost of an 
N' X N' matrix equation is {N') multiplications for a dense matrix. Thus the total cost is 

N'N [N' + ma + M) + ^ [N'f = ([ma + M) N' + {N'f^ N+^ {N'f 

> ((tog + M) N' + (N'f^ N, 

which is linearly dependent on the number of data points. However, by the use of a basis function 
with support containing only several points in X' e.g. the extended natural spline basis functions of 
Lemma [531 the construction and solution costs can be reduced significantly. However we still have linear 
dependency on N. ■ 



6.5 Solving the Approximate smoothing problem using matrix 
techniques 

In the last section, by using Hilbert space orthogonal projection techniques, the Approximate smoother 
matrix equation was derived for complex data and all conjugate- even basis functions. In this section we 
present an alternative derivation which uses matrix techniques. A key step in the Hilbert space approach 
was to choose a congugate-even basis function. This was sufficiently general and enabled us to prove 
that the Approximate smoother matrix was regular. This derivation is less general and imposes the 
extra conditions that the basis function and data are real valued. This is to simplify the use 
of the method of Lagrange multipliers and we note that the Approximate smoother matrix will now be 
symmetric and the basis function will be even. 

The Approximate smoothing problem is min Je [/] where Je [/] is the Exact smoother functional. 

The first step will be to calculate Je [f] for / e Wg,x' ■ The result is that Je [/] is a constrained quadratic 
form 16.211 in terms of the coefficients of the data-translated basis functions and the polynomial basis 
functions. Then it is shown that if the data is real and the basis function is real valued then the solution 
is unique and real valued. Finally, Lagrange multipliers are used to minimize the constrained quadratic 
form and derive the matrix equation as well as the identities derived using the Hilbert space method. 
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SO that combining 16.221 and 16 . 241 

N 

N 



1 ^ I 

Je[f] = p\f\le + ^T.\f 



13 J N \ ' ) V P 



6.5.2 Proof that the smoother is unique 

We will now supply another proof, this time based on matrices, that there exists a unique solution in 
Wg,x' for the Approximate smoother problem. After that we will obtain a matrix equation for this 
solution. 

Theorem 224 The Approximate smoothing problem has a unique solution in Wg,x' ■ 

Proof. The Approximate smoother problem involves minimizing the quadratic form 16. 2T] constrained by 

Px'Ot = 0. But from part 2 of Theorem 11051 the null space of P^, has the form a ~ [ \ a" 

where a" = ia^)f,j,, G r(^'"^^) and = Wij^M+v Set A ^ ( T^^M so that , ^ 
and the first term on the right of 16. 211 becomes 











In'J 


iV) 



(a^f) {^p^Gx'fl + ^G?Gp) ^ ) (6.25) 
Thus the Approximate smoother problem is equivalent to minimizing 16.251 for all a" G ^*^) and 



(3 G R^'. But if the matrix 



is positive definite then the quadratic form 16.251 has a unique stationary point and this is a minimum 
point. Indeed 

1 



p^a Gx',X'OL , ^ 



( Gx,x' Px 



= p^a^Gx',x'a + ^ \Gx^X'a + PxP\Im , (6.27) 

where PxiCt = 0. So the matrix [6.261 is positive definite if the matrix [6.271 is conditionally positive 
definite on null Pj, . So suppose 

p^a^Gx',x'a + ^ \Gx,x'a + PxPll^ = 0, P^,a = 0. (6.28) 
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Now by part 2 of Thcorcm ll661 Gx',x' is conditionally positive definite on P^,a = i.e. when P^,a = 
we have a^Gx',x'Ci > 0, and Px'Ct = and a^Gx' ,X'C^ = implies a = 0. Thus a^Gx' ,x'Ci = and 
Gx.x'a + PxP = i.e. a = and Px/3 = 0. But from part 1 of Theorem [TOl null Px = {0}, and this 
implies /3 = 0. ■ 

The next result will simplify the use of Lagrange multipliers to solve the Approximate smoothing 
problem. 



Theorem 225 Suppose the basis function G is real-valued with order 9 > 1. Then the solution to the 
Approximate smoothing problem with real valued 
the subspace of Wg,x' defined by the real scalars. 



Approximate smoothing problem with real valued data [X,y\ induced by the points X' = {x'l}^^-^ lies in 



Proof. The Approximate smoothing problem is min Je [/] and by the previous theorem this problem 

N' M 

has a unique solution. Now let / = ^ ctiG {■ — x'^) + J2 PjPj € Wq.x', where ai,(3j e C. Then by 
i=i i=i 

Theorem 



JAf]= a-p-) p^Gx.o + ^GlG, ^ -^y'G, " - ^y^G, ^ 



\y\ 



|2 



and so 



Je [7] = (s^/) Ugx';o + ^GlGp] ( " ) - ly^Gp ( ^ ) - ly^Gp 



a 



1 I |2 



f p^^-. + >i:g.) (I ) - [;)- ( I 



1 , |2 



N 



Thus, if s is the Approximate smoother then Je [s] = Je [s] and s is also a solution to the Approximate 

N' 

smoothing problem. But the solution is unique so s = s and s is real-valued. Hence if s = aiG {■ — x[)-\- 

1=1 

M N' M N' M 

J2 PjPj then s = s = J2 (• - x'j) + J2 PjPj and so J2 ("i - o^) G (• - x'^ + J2 {Pj - Pj) Pj = 0- 

j = l i=l j=l i=l j = l 

The unique representation result of part 5 Theorem 11661 now implies that for all i and j, Ui =1x1 and 

M 

Pj = Pj i.e. ai and Pj are real. This means that ^ PjPj G P9 and we are done. 

(J.J.S" The Approximate smoother matrix equation - a Lagrange multiplier derivation 
Recall that the Approximate smoothing problem is min Je [/] and so this involves minimizing the 

quadratic form I6.2T1 constrained by P^,a = 0. In Theorem 12241 it was proved that a solution to the 
Approximate smoothing problem exists and is unique. The proof also demonstrated that the constrained 
problem only has one stationary point which means the technique of Lagrange multipliers will always 
yield the Approximate smoother. For convenience denote the quadratic form l6.2T] bv Qa {a, P) and denote 
the Lagrange multiplier by the vector A with length N' . Since we have assumed the basis function is 
real- valued Theorem 12251 tells us that the Approximate smoother can be expressed in terms of real a 
and p. 
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In preparation we expand the matrix equation IG . 2 ll for Qa (a, (3) to include A and for algebraic simplicity 

- 

we will minimize NQa instead of Qa- Thus for real vectors a and /3, and — (27r) ^ p 



- f^T nT : .t\ ( Np,Gx':o + GlGp O 



O 



On' 



- 2y^ ( Gp On, 

Let the Lagrangian be denoted by L{a, (3, A) so that 
L{a, P, A) = NQa (a, /3) + 2X^P^,(3 



N' 



/ a \ 



\ ^ J 
/ a \ 

P 

V A ) 



NQa {a, P) + (a^ P'^ 



O O Px' 
O O O 
P^, O On' 



T nT : ,T^ f Np^Gx';o + GlGp O 
a p .\ ]\ ^ 



2y^ ( Gp On, 
(a^ P'^ X 



/ a \ 

P 



\ A / 

On' O Px 
O Om O 

>T 

X 



P^, O On' 



-,t^t:^t\ I Np^Gx'fl + G^Gp ^ 



a' P' : y 



Pi o 



On' 



a 



2y^ ( Gl On,n' ) I M + \y\' 



a 

P 
X 



( " \ 

P 

V A ) 



a 
X 



I " \ 

P 

V A I 



(6.29) 



A necessary condition for a minimum is that the derivative is zero i.e. DL{a, P, A) — 0. Differentiating 
equation 16.291 gives 

T i^T : ( Np^Gx'-Q + GpGp ^ 



DL= [a' P' -.X 



Pi. O 



O 



N' 



+ [a^p'^-X^^' ^P^^X';o + G%Gp 



^2\^a' P' -.X 
At the minimum, {DL)^ = 



Pi O 



T aT : ),t\ I Np^Gx';o + Gj,Gp 



Pi, O 



Px' 
O 

On' 



Np^Gx';o + GpGp Q 
Pi. O On' 



Px' 
O 

On' 



2y^ (Gp O) 



-2y^{Gp O) 



I " \ 

P 

V A / 



o 



y, 



(6.30) 
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and since Gp = ( Gx,x' Px 



Np^Gx'-fl + GlGp = Np^Gx'-o + ( Gx.x' Px ^ ( Gx,x' Px ) 



Np^Gx'-fl + ( ) ( Gx.x' Px 

Gx.x'Gx,x' GZ_x'Px 



Np^Gx':0 



X,X'^X,X' ^X,X' 

'xGx,x' PxPx 

T 



Np^Gx'.x' 0\ Gi,^,Gx,x' G{,^^,Px 
O O PlGx,x' P^Px 

Np^Gx'.x' + G^ x'Gx,x' G^ x'Px 
PlGx.x' ' P^'Px 



Thus 



ATn r -^rTr ^ x' \ i Np^Gx'.x' + Gx x'Gx,x' G^.x'Px 
Np^Gx,, + GpGp ^ \-ip^Gx,x' P^Px Om I , (6.31) 





Pi O On' ) \ Pi Om 

d 

and noting that p^ = (27r)2 p, equation 16.301 becomes 

{2^)i NpGx'.x'+G^x^.Gx.x' Glx,Px Px' \ f » \ ( G^^x' 
P^Gx.x' P^Px Om ]\ ] = { Pi 

Pi Om Om / V ^ / V O 

which matches the Approximate matrix equation l6.20l which was derived using Hilbert space techniques 
and assumed a complex valued basis function. 



6.6 Convergence of the Approximate smoother to the Exact smoother 

In this section we will study the uniform pointwise convergence on a bounded region of the Approximate 
smoother Sa to the Exact smoother Se and to the data function fd- 

In the first subsection we study the uniform convergence of the Approximate smoother to the Exact 
smoother. Here we make no use of Lagrange interpolation theory and obtain no order of convergence 
results. 

In the second subsection we again consider the convergence of the Approximate smoother to the Exact 
smoother but here we use Lagrange interpolation theory and order of convergence results are derived. 

The third subsection deals with the convergence of the Approximate smoother to the data function 
using the simple inequality 

\fd (x) - Sa {x)\ < \fd {x) - Se {x)\ + jSg (x) - Sa {x)\ , 

which combines the results of the previous subsection with those derived for the convergence of the 
Exact smoother to the data function in Section 15.71 



6.6.1 Convergence results not involving order 

The convergence results of this subsection do not involve data functions and the dependent data is just 
given as an arbitrary vector. Also, no data densities are estimated and no orders of convergence are 
calculated, as will be done in Subsection 16.6.21 We simply establish uniform pointwise convergence on a 
bounded data region. To start with we will introduce a concept of convergence for finite subsets of M.'^. 

( (i) ^ ^" 

Definition 226 Convergence of finite sets A sequence of finite sets Xn = ^Xn' j is said to 

converge to the finite set X — |a;^*^}^ denoted Xn — > X , if there exists an integer K such that when 

n > K , Nn = N and for each i, Xn ^ — a;^*-* — > as n oo. 

When n > K, X„ and X can be regarded as members o/R^'' and convergence as convergence in M.^'^ 
under the Euclidean norm. 
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Theorem 227 Suppose G is a basis function and s^ is the Exact smoother generated by the data [X, y]. 
Suppose is a sequence of independent data sets which converges to Xq in the sense of Definition 
I and that si"'' is the Approximate smoother generated by X'^ and [X, y] . 



Then the Approximate smoothers satisfy Je si""* —^ Je [se] as n oo, where Je is the functional used 
to define the Exact smoother. 

Proof. We first note that the definition of the convergence of independent data sets allows us to assume 
that the X!^ have the same number of points as X. 

Now suppose X' is an arbitrary independent data set with the same number of points as Xq and let 
So = Sa {X') be the corresponding Approximate smoother. If it can be shown that as a function of X' , 
Je [sa {X')] is continuous everywhere this theorem holds since Jg [se] = Je [sa i^)]- In fact, by Theorem 

N M 

Sa {X') (x) = ^ a.G (x - X-) + ^ f3jPj (x) , 
i=i j=i 

where a = {ai) and /3 = (/S^) satisfy the matrix equations 

I Pi 




O 



and the Approximate smoothing matrix is given by 



{2n)- NpGx'.x' + G^^,Gx.x' G^^'Px Px 
* - I P^Gx,x' P^Px 

Om 




Also, from part 4 CoroUarv 12141 and then 16.151 we have 

1 



[y-{Gx.,x' Pxj , ^ 




1 / / '^X.X' 

-y^ I In - iGx,x' Px O) ( 



O 



If we can show that Gx.x' and 5*^} are continuous functions of X' in a neighborhood of Xq then 
Je [sa {X')] is a continuous function of X' . But Gx',x' and Gx,X' are clearly continuous for all X' so 
^'x' and det 'fx' are continuous for all X' . Further, since by Theorem 12211 '^x' is positive definite and 
regular for all X', det 'fx' > for all X' and it is clear from Cramer's rule that 5"^} is continuous 
everywhere. Thus Je [so (^')] is continuous everywhere and the proof is complete. ■ 

The next corollary shows that for given data the Approximate smoother converges uniformly to the 
Exact smoother on R'' for the case that X' is a grid containing a data region and the grid size goes to 
zero. 

Corollary 228 

1. Suppose Se is the Exact smoother generated by the data [X, y] and that we have a sequence of 
regular, rectangular grids with grid nodes X'^, grid sizes h'^ and a fixed common grid region TZ - a 
closed rectangle - containing X . 

2. Let Sa (Xj^) denote the Approximate smoother generated by X'^ and data [X,y\. 

3. Assume that X d <Z TZ for all n, where the data region VL is a bounded, open, connected subset 
of having the cone property. 
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4- Assume that the conditions of Theorem \232\ hold. 

Then |ft,'J implies \\sa {X'^) ~ s^W^ g ^ and also that Sa (-^4) converges uniformly pointwise to 
Se on Q. 

Proof. For each data point a:;^'^' G X there exists a sequence of distinct points (^^rl^^^ such that 
zi^'> e and zi^'> x'-''^ in R'^ as n ^ oo. 

Set Zn = \ zn \ and let s (Zn) be the Approximate smoother generated by Then Z„ — > X as 

/c— 1 

independent data and by Theorem 12271 Jg [sq (2'„)] [s^]. 
But since Z^ C we have Je [sa (^4)] < -^e [sa (Zn)]- 
Also from the definition of Se we have Jg [sg] < Jg [sa {X'„)]. 
Thus 

[Sg] < Je [Sa «)] < [Sa {Zn)] , 

and SO Jg [Sa (X^)] ^ Jg [sg]. 

To establish the convergence of Sa we use part 2 of Corollarv ll721 namely that 

1 ^ 2 

fe=l 

for all / e AT^. Clearly f ~ Sa (X'^) imphes that as 72 — + oo, |sg — Sa (X^)]^ e ~* and Sa (-'^4) {x^''^) 
Se (a;^*''') for each k, and so 

M 

||Sg - Sa {Xl,)\\l g = \Se - Sa iX',)\l g + ^ |Sg (fl^) - (^'J (Orn)!^ ^ 0, 

m— 1 

where the minimally unisolvent set of points A = {flmlm^i C X define the Light norm ||-||^ g. Finally, 
if Rx is the Riesz representer of the functional f ^ f (x) defined by A then for x G fl 

|Sg (x) - Sa (a:;) (a;)| = (Sg - Sa [X'J , Rx)^^g 
< \\Se-Sa{X:Mg\\R,\\ 



2 



< ||Se-SaTOL,e(KU+|U^)|J 
= \\Se-SaiX'J\\^g lV^)+J2\lA^)\ 



M 



Our assumptions now allow us to choose A such that we can estimate ^r^ (x) and ^ \lj {x)\ using 
16.331 and 16.371 and so obtain 

\Se (X) ~ Sa {X'J {X)\ < ^5^(1 + K^g) (diamr!)"+'^ \\Se - Sa (X^'JL,^ , G f^, 

where CG.ri,a and -fC^ g are independent of x e il. Finally, since Sg and Sa are continuous on K.'' the 

estimate is actually valid on f2. Hence Sa {X'^D — > Sg uniformly, pointwise on f2 as n — > oo. ■ 

The next corollary replaces the rectangular grids by scattered sets of points and thus it can be applied to 
sparse grids, for example. This corollary shows that for given data the Approximate smoother converges 
to the Exact smoother on R'' if the scattered sets converge to the independent data in the sense of 
Definition!^ 

Corollary 229 

1. Suppose Se is the Exact smoother generated by the data [X, y] and that X d CI where the data region 
CI is a bounded, open, connected subset of R'' having the cone property. 
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2. Suppose that X'^ is a sequence of finite sets and that there exist a sequence of data sets X'^ such 
that Xj[ C X'j and X^ —>■ X in the sense of Definition \22b\ 

3. Assume that the conditions of Theorem \232\ hold. 

Then, if Sa (^") is the Approximate smoother generated by [X,y] and X", it follows that 
\\sa {X'^) — Se||,^ e ^ ^ '^'^'^ *a i^n) convcrgcs uniformly pointwise to s,, on Q. 

Proof. A simple modification of the proof of the previous Corollary 



6.6.2 Convergence to the Exact smoother 

In Subsection 15.7.11 we proved results concerning the pointwise convergence of the Exact smoother to 
its data function using results from Lagrange interpolation theory and the 'cavity' measure of indepen- 
dent data set density hx = sup dist (w; X). In this subsection we will employ the same techniques to 

wen 

derive conditions under which the Approximate smoother converges pointwise to the Exact smoother - 
conditions expressed in terms of the smoothing coefficient p and the densities of the data sets X and X'. 
We will require the following lemma which is derived from equation 15 . 291 and Theorem 1 1871 of Chapter 

m 

Lemma 230 Suppose X ~ ^ 6-unisolvent set and let A — {ai}f^^ be a minimally 9- 

unisolvent subset. Construct R^, V and Q = I — V using A. 

Then for each x G there exists a unique element Rv,x G V such that 

f{x)^iCxf,Rv..)y, feXl 

and 

P WRv.Al < (2^) + ^xp ^{x) p . (6.32) 

We will also need the following lemma which supplies some results from the theory of Lagrange 
interpolation. This lemma has been created from Lemma 3.2, Lemma 3.5 and the first two paragraphs of 
the proof of Theorem 3.6 of Light and Wayne [TU]. The results of this lemma do not involve any reference 
to weight or basis functions or to functions in X^, but consider the properties of the region il which 
contains the independent data points X and the order of the unisolvency used for the interpolation. Thus 
we have separated the part of the proof that involves basis functions from the part that uses the detailed 
theory of Lagrange interpolation operators. 

Lemma 231 (A copy of Lemma \14S^ Assume first that: 

1. is a bounded, open, connected subset of M."^ having the cone property. 

2. X is a unisolvent subset of of order 9. 

Suppose {Ijy'^Li is the cardinal basis of Pq with respect to a minimal unisolvent set offl. Using Lagrange 
interpolation techniques, it can be shown there exists a constant e > such that 

M 

Y.\h{^)\<K'nfi. 2; en, (6.33) 

i=i 

and all minimal unisolvent subsets ofil. Now define 

hx — sup dist {x, X) , 

and fix x G X . Using Lagrange interpolation techniques it can be shown there are constants cn,e, hn,e > 
such that when hx < there exists a minimal unisolvent set A <Z X satisfying 

diam^a; < cn,ehx, (6.34) 

where A^ = AU {x} . 
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The next result supplies conditions on the basis function which may yield a higher order estimate for 
(x) than Theorem 11501 

Theorem 232 (Copy of Theorem \15b]) Suppose w is a weight function with properties W2 and W3 for 
order 9 and k. Set rj = min|0, ^ [2kJ}. Also suppose G is a basis function of order 6 such that the 
distributions {D^G} ^^^^^^^^ are L]^^ functions such that for each fixed b ^ the integrals 



[ {l-tf'^\{D'^G){z + tb)\dt, z,beR'', |/3|= 277 + 1, 
Jo 



3.35) 



have polynomial growth in z. 

Further, there exist constants rcccri > and >0 such that 

\b^\ f\l~tf''\{D^'G){tb)\dt<^\b\^^''+^''\ \b\<rG, 1/31 = 27^ + 1. (6.36) 
Jo 2ct 

Regarding unisolvency, assume A = {afc}^^^ minimal 6-unisolvent set and that {lk}kLi 
corresponding unique cardinal basis for Pg. Now construct V, Q, Rx using A and {lk}^^i- 



Now if rx — QRx we have the estimate 



\/ rx {x) < ^fc^^^ 1 + ^ l^fe (x)| (diamAj,) 



diamA^ < re, a; e r2, (6.37) 



where a = min {6', i [2k + IJ }, = A U {x} and CG,rj,a = ^^^ji/'Jp^^ , cg,»;- 

Remark 233 In Section \4-ll\ V and 5 a were calculated for the thin-plate and shifted thin-plate splines 
by way of examples. 

We now derive our estimates for the pointwise convergence of the Approximate smoother to the Exact 
smoother. 

Theorem 234 We will need the following assumptions and notation: 

(a) Suppose w is a weight function with properties W2 and W3 for order 9 and k, and set rj = 
min {9, ^ [2kJ } . Assume G is a basis function of order 9 such that there exist constants cq, r^ > 
and 6g >0 satisfying \6.37\ Set r]Q ^ r/ + Sq. 

(b) Denote by Sg the Exact smoother generated by the the smoothing parameter p, the independent data 
X and data function fd G . 

(c) Assume X <Z where the data region Q, has the properties given in the Lagrange interpolation 
Lemma \281\ and the constants ha,e , CQ„e ^ K'q^ q are as given in Lemma \2Sl\ Regarding Theorem \2S2\ 
set 

(27r) [cr]! 

(d) Denote by Sa the Approximate smoother generated by the unisolvent set of points X' C 51. Let 

hx — sup dist (w, X), hx' — sup dist (w, X') measure the density of the point sets X and X' . 

cj (E o uj^n 

Then when hx, hx' < min {hn^g, re} we have for x e 
1- Iffd&Wa.x' 

|Se {X)-Sa {X)\ < \fd\^^g{l+K'n,g) [^J^^ {cnfihxf'' + ^N^f) . 

2. Iffd^Xi 

W{x)-sAx)\ < |/dL,g (l + (1 + K'^fi) V^^ ^'"''^'^"" ) X 

X (1 + K[-, g) ( {cnfihxT'' + v/^^) • (6.39) 



Two similar bounds on the error for large p are: 
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3- iffdexl 



\se{x) - Sa{x)\ < g V^c?;^ (l + A'^ e) ^ (diam i^V^G^, 



VP 



X 



5- If fd G Pe then fd = Sa- 

Proof. Fix X G and construct = QRx, Se and Sa from a minimal (?-unisolvcnt set A d X. From 
Lemma 12301 

|Se (a;) - Sa {x)\ = \{Cx {Se - Sa) ,Rv,x)v\ < W^X {Se " Sa)\\y \\Rv,x\\v ' 

But from part 5 Summary 12101 \\Cx {se — f)\\v — W^xf — for all / G Wg,x'- Choose f = Sa so 
that by part 1 Summary 12101 



and hence 
But hyEM 



so that 



i{x) < E l^fc(^)l < 
fc=i 



\Se (x) - Sa ix)\ < a/ Jg [Sa] \\Rv,x\\v 

p\\Rv,xfv < rx (x) + Nxp\Tix) 

\Se (x) - Sa {x)\ < VXIsJ-^ (^V (x) + \/ N x P ^ {x) 

By Lemma [2311 there exists a constant K'^ g, independent of x G ft, such that 

\Se (x) - Sa {x)\ < ^ J e. \-^'^~Jj^ (V^a; {x) + K'^ g^^XP^ , 

and the estimate 16.371 for (x) on fl implies 

\/rx (x) < yf^d~^ {\ + \lk (diam^^)''^ < .J^^{\ + K[^^e) (diam A:,)''^ , 

proyided diam < tq. But an assumption of this theorem is hx < min{/if^^e, re} so by Lemma l231l 
A can be chosen so that diamA^; < CQ ghx so that 



V Tx {x) < ^CG,-n,a (1 + K'^fi) {cnfihxY^ 



(6.40) 



and 



\s,{x)-sa{x)\ < V '^^^'^i (1 + K',,^^^ [V^^ (cnAxT" + y/N^) 



VP 



Thus when / G Wg,x' and f ^ Sa^ the definition of implies Jp [sa] < Je [/] and 

\Se (X) - Sa {X)\ < (l + VW] (v^^^^^^^^ + 

The estimates for |se (x) — Sa {x)\ stated in the theorem will be proyed by substituting yarious / G 
Wgx' into Em 



(6.41) 
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Part 1 We choose f ^ fd e Wg,x'- Then J, [/] = p\fd\l^g and EH] imphes 

\se (x) - Sa {x)\ < Ifd^g (l + K'^^g) [^^^ {cn^ehxT^ + ^N^p) , x^n, 
the extension to Vl being vahd since both and Sa are continuous on R*^. 

Part 2 Choose / — T'x'fd where T'-^, fd is the minimal scminorm intcrpolant of fd on the unisolvent 
set X' . Then by Corollary [1571 when hx' < min {/ifj^g, tg} it follows that 

\fd{x)-I'x,fd{x)\ < \fd-rx'fdL^gil + KM)V^^icn,ehx'r'' , x eH, 

and so, by using the properties: l^x'/Le ^ l/Le and < \ f\^g, of part 2 Theorem 

EZl ' ' ' ' 

Je [/] = Je [^X'fd] 

1 2 

= P \^'x'h\l,e + ^ E Y^'x'fd) {-^'^) h {x^'^) 
fc=i 

< P l^x'fdte + \fd ~ ^'x'fdt^g (1 + K'^,efcG,^,, {cnfihx'f'' 

< P Ifdll^e + \fd\l,e (1 + K,eT cg,,,. (co,e/ix')""^ 
= \fd\l,e (P + (1 + K'n,eT ca,,,,. {cn,ehx'f'^) , 

i.e. 



Hence by 16.411 

\Se (x) - Sa ix)\ 



< \fdL,9{VP+{^ + K,e)V^^icnMhx'y"'){l + K'^,e) [v^^ 
= l/dL,9(l+(l + ^o,e)V^ 



VP 



+ VN 



X 



VP 



(1 + K'^^g) ( {cnMhxf + Vn^p) , 



Part 3 Suppose V, Q' are r'^ are defined using a minimal unisolvent subset A' C X'. Choose / = V fd 
Then 



Je if] = Je [P'fd] = P W'fdllg + ^ E | C^' f'^) (^^^O " ^'^ {' 

fe=l 

1 ^ 

4E|(e7.)(x"') 

— ]^ E l-^f^L^e ka;' 
2 1 ^ , 



fc=l 



< Ifdllfi'^^^yM^S 

= l/dlLemaxr^ (w) . 



(fc) 
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From 133 

\/r^ {x) < y^^^ (1 + K'^^e) (diam ft)"^ , x e ft, 
and since this is still true with A replaced by A' we have 



and substitution into 16.411 

\s,{x)-sa{x)\ < (1 + K^e) yXITI I^V^^ ^''"''^^^'' + V^) 



VP 



which proves this part for x Q. Continuity on is valid since Sg and Sa are continuous on R . 

Part 4 Choose / = so that Je [/] = Je [0] < I max |/d I and substitution into 16.411 yields this 

\wen ) 

part for a; G il. Continuity on is valid since Se and Sa are continuous on M''. 

Part 5 If /d e Pq then by part 4, Jg [sq] = and so |sq|^ g = and Sa {xS^^^ = fd (a;^'^^) for aU 
a;(fc) £ X. Thus Sa e Pg and so Sa = /d- But by property 2 of Theorem [TTSl = / iff / G Pe and 
consequently Se = fd, proving this part. ■ 

Remark 235 

1. The error formula of part 1 above is the same as the general Exact smoother error estimate of 
Theorem \236\ Chapter\^ However, here it only applies to the special finite- dimensional subspace of 
data functions Wg,x' ■ Thus a sequence of independent data points X and smoothing coefficients 
p can be chosen so that the corresponding sequence of Approximate smoothers converges uniformly 
pointwise to the sequence of Exact smoothers, independently of the chosen X' . 

2. The right-most factor of the estimate derived in part 2 of Theorem \234\ is the estimate for the Exact 
smoother given belouj in Theorem \23b\ If we choose p such that 

(6.42) 

and then require that ( 1 + A ccrj.a- Jp — = 1 we get 

. / n 



na VP y/TvJ {cn,ehxT'^ 



So if in addition 



< — rTM^^ (6-43) 



then 

\sa{x)-s,{x)\<A\fd\^,{l + K[,^g)^E^{cnfihxT'' , x e H. (6.44) 
Hence if the sequences Xk and X'^, are such that hx^ and hx' — > and p/. is constrained 



< 



by \6.42\ then there is a subsequence Xj^ of X'f, such that hx' ^ , ^ n i/ig 

the sequence of Approximate smoothers converges to the sequence of Exact smoothers in the sense 
implied by \6.44\ 

If X' is a regular grid then hx' can be calculated exactly: 

di vol [grid) = Nx' (hx'f ■ (6.45) 
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3. The approach of part 2 can he augmented by assuming a relationship between Nx and hx • This 
was done in Section 4-8 Williams '221 for the zero order Exact smoother and in Remark \l 94\ for the 
positive order Exact smoother. Several 1- dimensional numerical experiments were run to compare 
the convergence of the zero order Exact smoother with the predicted convergence. 1-dimensional test 
data sets were constructed using a uniform distribution on the interval U, — [—1.5,1.5]. Each of 
20 data files were exponentially sampled using a multiplier of approximately 1.2 and a maximum 
of 5000 points, and then logi^hx was plotted against logi^Nx where Nx — It then seemed 
quite reasonable to use a least-squares linear fit and in this case we obtained the relation 

hx ^i-Q^N-^-^^. (6.46) 

For ease of calculation let 

hx = hi{Nx)~°' , /ii = 3.09, a = 0.81. (6.47) 

A barrier to the use of such a formula as \6.4()\ in higher dimensions is the difficulty of calculating 
hx for such data sets. If a sequence of independent test data sets was generated by a uniform 
distribution in each dimension then the constants a and hi might he defined as the upper bound of 
the confidence interval of a statistical distribution. Also, noting the regular grid formula \6.45\ we 
might hypothesize a relationship of the form 

hx^ha {NxV'''^ 

for higher dimensions. 

4. A similar approach, following Chapter^and Chapter\^for the Exact smoother, is to substitute for 
Nx and Nx' in 1 6. 39\ and minimize the estimator for p. 

6. 6. 3 Convergence to the data function 

In the previous subsection we studied the convergence of the Approximate smoother to the Exact 
smoother. In this subsection we wih combine these results with the Exact smoother error and thus 
estimate the error of the Approximate smoother. The relevant result concerning the Exact smoother 
error is Theorem 11911 and our next result combines this result with Theorem 12321 above: 

Theorem 236 

1. The notation and assumptions of the Lagrange interpolation lemma (Lemma \231\) hold. 

2. Let w he a weight function with properties W2 and W3 for order 9 and parameter k and set 
rj ~ min|0, i [2kJ}. Assume G is a basis function of order 9 such that there exist constants 
CGjfG > and So >0 such that the estimate of the form \6.37\ holds i.e. 

Vrx (x) < ^ ^ ^ '''^ (diam A^)''^ , diamA^ < a; G f^, 

where r\Q ~ r]^ 8q. 

3. Denote by Se the Exact smoother generated by the the smoothing parameter p, the unisolvent inde- 
pendent data AT C il and data function fd G A'^ . 

Then when hx < min {h^ g , re} , 

\se{x)- fdix)\<\fdL^g{l + K^e)(^y^{cn,9hxT'' + Vn^), x eU. (6.48) 
We now present our main result for the convergence of the Approximate smoother to the data function. 
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Theorem 237 We will use the assumptions and notation of Theorem \236\ and Lemma \231\ Now denote 
by Sa the Approximate smoother of the data function fd generated by the data set X and the points X' . 
Let hx' — sup dist {lu, X') measure the density of the point set X' . 

Then when hx,hx' < min ^g}; x G and fd € X^ the estimate 

\fd{x) - Sa {x)\ 

< \UL,e (1 + KLe) {V^icnAxr^ + v^) (2 + (l + ^^0,9)' cg 

holds. 



Proof. From 167391 



W{x)-sa{x)\ < \fdU (1 + (1 + Kke) V^ ^'"-'^'^"" ) 



(1 + K'^^o) (cnAxY"' + 



X eft, 



and fromin!' 



\fd (x) - Se ix)\ < IfdL^s (1 + Ki,^e) {V^ (co.e/ix)"^ + ^/N^) , x e n, 



so that 



\fd (x) - Sa {x)\ 

< \fdix) - Se{x)\ + \Seix) - Sa{x)\ 

< \fdUo (1 + K.e) {V^ {c^fihxf^ + + 



\fd 



1 + (1 + K[^,g) ^ 



X' 



\fdL,o (1 + K'n^e) {V^{cn,ehxr^ + (2 + (l + K'^,e) 



(6.49) 



(1 + K',,^o) [v^icnMhxT" + Vn^) 



Remark 238 

1. Comparison of the Approximate smoother error estimate proved in the last theorem with that of the 
estimate of part 2 of Theorem \234\ shows that the convergence analysis given in Remark \235\ can 
be applied to the estimate \6.49\ 



2. The Approximate smoother error estimate \ 6.49\ is not bounded in p near zero or near infinity. 
However, estimates that are bounded in p near infinity can be derived as follows: First estimate 
\se (x) — Sa {x)\ by Combining the estimate \6. 39\ with those of either part 3 or part 4 of the same 
theorem. Then add an Exact smoother error estimate from Theorem \2Ul\ to obtain the Approximate 
smoother error bounded in the smoothing parameter. 



3. We now show that there exist sequences X'^., Xk and pi^ such that fd (x) — s'^a^ (x) 
on il; 

The estimator \6. 4 9\ has the form {A + Bx) (C + D/x) where x — ~Jp, A — ^^cq {cfi^hx)^'^ , B 
V^Vx. C = 2 and D ^ (l + K^^ g) ^ icn,ehx'T'' ■ 



uniformly 



The estimator is minimized to [^\/ AC + V BDj when p = AD/BC i.e. 

\fdix)-saix)\ < (^VAC + VbdY 
< AC + BD 



6.7 A numerical implementation of the Approximate smoother 
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whe 



(1 + K[,^,) ^ 



X 



Hence if I h 



i-xi 



then 



fd {x) - si^^ {x) 



These error estimates are quite unsatisfying! Phil must do better. 



6.7 A numerical implementation of the Approximate smoother 
6.7.1 The SmoothOperator software (freeware) 

In this section we discuss a numerical implementation for the construction and solution of the zero order 
Approximate smoother matrix equation lG.lOl i.e. 



(27r)^ NpGx'^x' + Gx',xGx,x' Gx'.xPx 

P^Gx,x' P^Px Om \ \ P' \ = \ Px \y, 

Pi Om 

I called this software SmoothOperator. In Corollary [2221 it was shown that the construction and solution 
of this matrix equation is a scalable process and thus worthy of numerical implementation. This software 
also implements the zero order version of this equation which is derived in Williams |22j and the tutorials 
concentrate on the zero order basis functions. 

The algorithm has been implemented in Matlab 6.0 with a GUI interface but has only been tested 
on Windows. SmoothOperator can be obtained by emailing the author. However there is a short user 
document (4 pages) and the potential user can read this document first to decide whether they want 
the software. The top-level directory of the software contains the file read_me.txt which can also be 
downloaded separately. A full user manual (82pages) comes with the software. The main features of 
the full user manual are: 

1 Tutorials and data experiments To learn about the system and the behavior of the algorithm, 
I have prepared three tutorials and five data experiments. 

2 Context-sensitive help Each dialog box incorporates context-sensitive help which is invoked using 
the right mouse button. An Fl key facility could be implemented. The actual help text is contained in 
the text file \Help\ContextHelpText.m that can be easily edited. 

3 Matlab diary facility When the system is started the Matlab diary facility is invoked. This means 
that most user information generated by SmoothOperator and written to the Matlab command line is 
also written to the text diary file. Each dialog box has a drop-down diary menu which allows the user to 
view the diary file using Notepad. There is also a facility for you to choose another editor/browser. The 
file can also be emptied, if, for example, it gets too big. It can also be disabled. 

4 Tools for viewing data files Before generating a smoother you can view the contents of the data 
file. 

For ASCII delimited text data files, use the (slow) View records facility to display records and the 
file header, and then with this information you can use the high speed Study records facility to check 
the records and then obtain detailed information about single fields e.g. a histogram, and multiple fields 
e.g. correlation coefficients and scatter plots. 

For binary test data files only the View records facility is needed. The parameters which generated 
the file can also be viewed using the Make or View data option. 

5 The output data The output from the experiments and tutorials mentioned in point 1 above 
consists of well-documented Matlab one and two-dimensional plots, command line output and diary 
output. There is currently no file output, but this can be implemented on request. 

6 Reading delimited text files A MEX C file allows ASCII delimited text files to be read very 
quickly. You can specify: 




a' \ 




( Gx',x 






Pi 






\ Om,n 
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6.1 that the file be read in chunks of records, and not in one go. 

6.2 The ids of the fields to be read. This means that the file can contain non-numeric fields. 

6.3 Fields can be checked to ensure they arc numeric. 

The tutorials which create smoothers allow the data, smoothed data, and related functions to be 
viewed using scatter plots and plots along lines and planes. 

7 Please note that there is no explicit suite of functions - application programmer interface or API - 

supplied by SmoothOperator for immediate use by the user. After reflecting on how I would create such 
an API, I decided that I lacked the experience to produce it, and that, anyhow, there were too many 
possibilities to anticipate. I would expect that possible users of this software, designed to be applied to 
perhaps millions of records, would need to familiarize themselves thoroughly with how this system works. 
I urge them to contact me and discuss their application. 

6.7.2 Algorithms 

The following three algorithms are used in the SmoothOperator software package to calculate the Ap- 
proximate smoother. 

Algorithm 1 uses data generated internally according to specifications supplied by the user using 
the interface. The smoothing parameter can be either specified or calculated using an error grid. This 
algorithm is scalable. 

Algorithm 2 uses a 'small' subset of actual data to get an idea of a suitable smoothing parameter to 
use for the full data set. This algorithm is not scalable. 

Algorithm 3 uses all the actual data. The smoothing parameter can be either specified or calculated 
using an error grid. This algorithm is scalable. 

We will now explain these algorithms in more detail. 

Algorithm 1: using experimental data 

1. Generate the experimental data [X, y]. The independent data X is generated by uniformly dis- 
tributed random numbers on X. The dependent data y is generated by uniformly perturbing an 
analytic data function g^at. 

2. Choose a smoothing grid X' whose boundary contains X. Choose an error grid X'^^^ which will be 
used to estimate the optimal smoothing parameter p. 

3. Read the data [X, y\ and construct the matrix equation. If the matrix Gx,x' is dense, the matrix 
Gx x'^x.x' is constructed using a Matlab mex file (a compiled C file). If Gx,x' is sparse the usual 
matrix multiplication is used. 

4. Given a value for the smoothing parameter p we can solve the matrix equation and evaluate the 
smoother. 

We want to estimate the value of p which minimizes the 'sum of squares' error between the smoother 
and the data function 

Empirical work indicates a standard shape for di (p), namely decreasing from right to left, reaching 
a minimum and then increasing at a decreasing rate. To find the minimum we basically use the 
standard iterative algorithm of dividing and multiplying by a factor e.g. 10 and choosing the 
smallest value. The process is stopped when the percentage change of one or both of 6i (p) and p 
are less than prescribed values. 

Algorithm 2: using a 'test' subset of actual data 

1. Perhaps based on results using Algorithm 1, choose an initial value for smoothing parameter p and 
choose a smoothing grid X'. 

2. Step 2 of Algorithm 1. Denote the data by [X,y] where X — (a;*^*') and y = (yi). 
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3. This is the same as step 4 of Algorithm 2 except we now minimize 

N 2 

S2{p) = Y.{ap(x^'^)-yi) , p>0, (6.50) 

because we do not have a data function. 

Algorithm 3: using all the actual data 

1. Choose a value for smoothing parameter p, based on experiments using Algorithm 2. Choose a 
smoothing grid X'. 

2. Read all the data [X, y] and construct the matrix equation. If the matrix Gx,x' is dense, the matrix 

xiGx,x' is constructed using a Matlab mex file (a compiled C file). If Gx,x' is sparse the usual 
multiplication is used. 

3. Solve the matrix equation to obtain the basis function coefficients and evaluate the smoother at 
the desired points. 

6.7.3 Features of the smoothing algorithm and its implementation 

1 The Short user manual and the User manual contains a lot of detail regarding the SmoothOperator 
system and algorithms. So we will content ourselves here with just some key points. 

2 Although the algorithm is scalable there can still be a problem with rapidly increasing memory usage 
as the grid size decreases and the dimension increases. The classical radial basis functions, such as the 
thin plate spline functions, have support everywhere. Hence the smoothing matrix is completely full. To 
significantly reduce this problem we do the following: 

a) We use basis functions with bounded support. 

b) We shrink the basis function support to the magnitude of the grid cells. This makes x'^x,x' 
a very sparse banded diagonal matrix, and Gx',x' has a small number of non-zero diagonals. We say 
this basis function has small support. 

3 Instead of using the memory devouring Matlab repmat function to calculate Gx,x' and Gx',x', we 
directly calculate the arguments of the Matlab function sparse. This function takes three arrays, namely 
the row ids, the column ids and the corresponding matrix elements, as well as the matrix dimensions, 
and converts them to the Matlab sparse internal representation. I must mention that although this is 
quick and space efficient, the algorithm is much more complicated than using repmat. 

Matlab's sparse multiplication facility is then used to quickly and efficiently calculate x'^x,x'- 

4 A selection of basis fimctions is supplied. 

5 Note that this softwEire was written before I embarked on the error analysis contained 
in this document so SmoothOperator concentrates on the Approximate smoother and the user cannot 
study the error of the Exact smoother or the Approximate smoother or compare the Approximate 
smoother with the Exact smoother. 

6.7.4 application - predictive modelling of forest cover type 

In this section we demonstrate how the method developed in the previous sections can be used in data 
mining for predictive modelling. This application smooths binary-valued data - 1 was unable to obtain 
a large 'continuous-valued' data set for distribution on the web. The source of our data is the web site 
file: 

http :/ /kdd. ics.uci. edu/ databases / covertype / covertype . html, 

in the UCI KDD Archive, Information and Computer Science, University of California, Urvine. 
The data gives the forest cover type in 30 x 30 meter cells as a function of the following cartographic 
parameters: 

Forest cover type is the dependent variable y and it takes on one of seven values: 
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Id 


Independent variable 


Description 


1 


ELEVATION 


Altitude above sea level 


2 


ASPECT 


Azimuth 


3 


SLOPE 


Inclination 


4 


HORIZ.HYDRO 


Horizontal distance to water 


5 


VERT.HYDRO 


Vertical distance to water 


6 


HORIZ.ROAD 


Horizontal distance to roadways 


7 


HILL_SHADE_9 


Hill shade at 9am 


8 


HILL_SHADE_12 


Hill shade at noon 


9 


HILL_SIIADE_15 


Hill shade at 3pm 


10 


HORIZ.FIRE 


Horizontal distance to fire points 



TABLE 6T. 



Forest cover type 


Id 


Spruce fir 


1 


Lodge-pole pine 


2 


Ponderosa pine 


3 


Cottonwood /Willow 


4 


Aspen 


5 


Douglas fir 


6 


Krummholtz 


7 



TABLE 6.2. 



The data file 

In this study we will use the data to train a model predicting on the presence or absence of the 
Ponderosa pine forest cover (id = 3), but the results will be similar for the other forest types. To 
this end we have created from the full web site file a file called \UserData\forest_l_to_10_pondpin.dat 
which contains the ten independent variables of Table 16.11 and then a binary dependent variable derived 
from the variable Ponderosa pine of Table 16.21 This variable is 1 if the cover is Ponderosa pine and 
zero otherwise. 

Methodology 

We recommend you first use the user interface of the SmoothOperator software to construct artificial data 
sets to understand the behavior of the smoother and run the experiments to get a feel for the influence 
of the parameters. 

1 We chose a small subset of the forest-cover data and selected various smoothing parameters and 
smoothing grid sizes to study the performance of the smoother using plots and the value of the error. 

Note that two subsets of data could be used here, often called the training set and the test set. The 
training set would be used to calculate the smoother for the initial value of the smoothing coefficient, 
and then the test set could be used to determine the smoothing coefficient which minimizes the least 
squares error. 

2 Having chosen our parameters we run the smoother program on the full data set. 



Appendix A 

Basic notation, definitions and symbols 



A.l Basic function and distribution spaces 

Definition 239 Basic function and distribution spaces 

All spaces below consist of complex-valued functions: 

1. Pq = {0}. For n > 1, Pn denotes the polynomials of (total) order at most n i.e. degree at most 
n — 1. These polynomials have the form ^ Oa^" , where Oa E C and ^ G M.'^. The space of all 

\a\ <n 

polynomials will be denoted by P. 

2. C^^"^ is the space of continuous functions. 

Cg"^ is the space of bounded continuous functions. 

Cgp is the space of continuous functions bounded by a polynomial. 

CM = { / e C^°'> : D"f e C(°), when \a\ = m}. 

Cjj™^ = {/ e • e '^b\ when \a\ < m}. 

Cjj™^ = {f e Cfp : D"f e when \a\ < m}. 

m>0 m>0 r?j>0 

3. Ljg^ is the space of measurable functions which are absolutely integrable on any compact set i.e. 
any closed, bounded set. 

is the Hilbert space of measurable functions f such that J \f \ < oo. Norm is \\f\\-^ = J \f \ and 
inner product is (/, g)^- 

L is the Hilbert space of measurable functions f .such that J \ f\ < oo. Norm is|l/|l2=(/l/l ) 
and inner product is {f,g)^. 

L°° is the space of a.e. bounded functions. Norm is \\f\\^.and inner product is if,g)^- 

4- is the space of functions that have compact support. These are the test functions for the 
space of distributions defined on , sometimes denoted by T). 

S is the space of rapidly decreasing functions. A function f G C°° is in S if given any multi- 
index a and integer n > 0, there exists a constant ka^„ such that, \D°'f {x)\ < ka^n (1 + |a;|) 
X G R'^ . These are the test functions for the tempered distributions of Definition \24S\ below. 

V is the space of distributions (generalized functions). 

£' is the space of distributions with compact (bounded) support. 
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A. 2 Vector notation 



Definition 240 Vector notation 

Suppose V and w are real vectors: 

• = (0,0,...,0) anrfl = (1,1,..., 1). 

• Suppose ~ is one of the binary operations <,<,=,>,>■ 
Then we write v~w if vfun for all i. 

For a; e R we write v~x if vfx for all i. 

• //seR thenv^=v^^. 



A. 3 Topology 

Definition 241 Topology on 

• The Euclidean norm an inner product are denoted by \x\ and {x,y). 

• Ball B [x; r) = {y : \x — y\ < r}. 

• £— neighborhood of a set - for £ > 0, the e— neighborhood of a set S is denoted and = 

U B{x;e). 

xes 

A. 4 Multi-indexes 

Definition 242 Multi-indexes 

1. Multi-indexes are vectors with non-negative integer components. 
Let a = (ai, a2, . . . , ad) and (3 = (/J^, /32, . . . , (3^) be multi-indexes. 
Suppose ~ is one of the binary operations <, <, =, >, >. 

Write (3~a if j3{'ai for all i. 
For X e K write (5~x if (ifx for all i. 
d 

2. Denote \a\ = ^ aj. Then D"f {x) is the derivative of the function f of degree a 

i=l 

D'f{x)=f{x), D-f{x) = ^^I^^^^^l^-^ 



D'^'xiD^'x2...D'^'xd 

3. We shall also use the notation 

monomial x°^ = x'^^x'^'^ . . . a;^"*, 
factorial a\ = ai\a2\ ■ ■ ■ ctj}- and 0! = 1, 

^'""'"^''^ G) = (^4)1:5!' 

4-. The inequality \x°'\ < |a;|'"' is used often. 
5. Important identities are 



6. Leibniz's rule is 



(uv) = E (^^D^'uD'^-^v. (A.l) 
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A. 5 Tempered distributions 

Definition 243 Tempered distributions S' (also temperate or generalized functions of slow growth) 

1. S is the space of rapidly decreasing functions. We endow S with the topology defined using the 
countable set of seminorms Pn,a given by 



P«,a W = 11(1 + 1-1)" C^V-IL. ^1 = 0,1,2,, 



a > 0. 



2. S" is the space of tempered distributions or generalized functions of slow growth. It is the set of all 
continuous linear functionals on S under the seminorm topology of part 1 of this definition. 

3. A linear functional on S is continuous if its absolute value is bounded by a finite positive linear 
combination of seminorms. 

4-. If f S' and (j) Cz S then [/, (j)] £ C will represent the action of f on the test function (f>. 

A. 5.1 Properties 

1. The continuous embeddings S C C^p <Z S' gV are dense. 

2. If / e L\^^ and, / (1 + \x\y^ dx or |/(a;)| \x\~^ dx exist for some A,r > 0, then / e S" 
with action [/, — J f (x) (f> (x) dx., (j) € S. We cah / a regular tempered distribution (function) 
e.g. Example 2.8.3(a) Vladimirov fIT\ . 

3. If / e S' and a g Cg'p then af e S" e.g. Example 2.8.3(e) Vladimirov [5T] but note that Vladimirov 
denotes C^p by 9m- 



A. 6 Fourier Transforms 

Definition 244 Fourier and Inverse transforms on S and S' . 

1. If f ^ S then let the Fourier transform be 

m^i^^r'^'J e-'^^f{x)dx. 

Where convenient the alternative notation F [f] = f will be used. 
The mapping f ~^ f is continuous from S S. 
The inverse Fourier transform is 



e''"'fix)dx. 



Where convenient the alternative notation F ^ [f] — f will be used. 



We have the important property that ( / ) = /. 
2. Iffe S' and(j)eS then 







V 




'v 




v" 


'l4> 






and 






/,0 



The mappings f f and f —f f are continuous from S' ^ S' . 
We have the important property that ^/^ = /. 
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A. 6.1 Fourier transform properties on S and S' 

1. If 6 is a complex constant then (/ {x + b))^ — e^^^ f . 

2. /(O = /(-O, /(O = /(O and /(O - / (-0-/ 

3. If 6 is a complex constant then (e*''^)^ — (27r)''^^ 5 (i^ + 6). 

4. D"/ = (-i)'"' x°^f and = (x"/)"". 

8. {2ny'^/^ and T = (27r)'*/^ S. 

9. {2TTf/^ {iDf S and 5^6 = {2^)^'^/'^ (-i)'"' C- 

10. If p is a polynomial then p= {2'k)'''^^ p{iD)6, and / — pi^iS,) /• 

A. 6. 2 Fourier transform properties on £' 

1. Suppose f G £' , rj G and 77 = 1 in a neighborhood of the support of / - denoted supp /. Then / 
can be extended uniquely to S" by [/, cf)] — [/, 77^], where (j) £ S. e.g. Example 2.8.3(b) Vladimirov 
PT] but note that Vladimirov denotes C^p by 9m- 

2. If / e f ' then f e S' in the sense of part land fe Cfp e.g. Theorem 2.9.4 Vladimirov [H]. 

A. 7 Convolutions 

Definition 245 Convolution 

1. If f e C'pp and<j)e S then f ^ cf) C^p where 

if * 0) (x) = (x) = {2Tr)-i J f{x-y)<f> (y) dy = (27r)-^ j f{v)c^{x- y) dy. 

2. The previous definition can be extended to S' by the formulas 

f^^ = ^^f={4>fY^{2i,)'i[fy,(p{--y)], feS\ <j,eS. 

Here f*(j) G Cfp. 

3. Noting parts 1 and 3 of Avvendix \A.5A[ the following definition is consistent with parts 1 and 2: 

f*9^9*I^{gf)\ feS',geiC^pf. 

Here f*(j)e S". 

4. Also, noting the results of Appendix ] A. 67^ 

f*g^9*f^{gfy, feS',ge£'. 

Here f * g e S' 

5. Iffe and g £ C^°^ then f * g is a regular tempered distribution and 

if * 9) (x) = {9* f) {x) = (27r)"^ j f{x-y)g (y) dy = (27r)"^ J f {y-^ g {^^ - y) dy. 
This can be proved using Theorem 2.7.5 of Vladimirov I21f . 
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A. 7.1 Convolution properties 

For the convolutions defined in parts 2 and 4 above: 

1- f*9 = g*f- 

2. {f*g)^f^ D°'g = D'^f * g for all a. 

3. {f*9T=9l where /e 5'. 

4. The mapping / — > / * g' is continuous from S' to S". 



A. 8 Taylor series expansion 

Suppose u : K'^ ^ C and M e C^") {W^) for some n > 1. Then the Taylor series expansion about 2; e M 
is given by 

u{z + b)=Y.^^ {D^u) {z) + {Unu) {z, b) , (A.2) 

\0\<n ^' 

where TZnU is the integral remainder term 



{Tlnu) [z, b) = 




(A.3) 



which satisfies the estimates 

|(7^„^i)(z,5)| < ^ll^ max \{D('u){y)\, (A.4) 

n! |/3|=n 
3/e[z,^+5] 

and 

(^,6)1 < 161" E v^^^ , K^^") • (^-5) 

■J-—' ye [z, 2+6] 



Appendix A. Basic notation, definitions and symbols 
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